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(54) Apparatus for and metfiod of embedding and extracting digital infdrmation and medium 
having program for canrying out the method recorded tlieron 



(57) A band division portion 1 1 receives an image 
signal 71. and divides the image signal 71 into 10 fre- 
quency bands by discrete wavelet transform, to calcu- 
late transform ooeffidents. A bfock division portfon 12 
divides an LL3 signal obtained by the division into a plu- 
rality of blocks previously determined. A quantization 
portion 13 finds for each of the blocks a mean value M 
of the transform coefficients, and subjects M to linear 
quantization using a quantization step-size Q previously 
determined, to calculate a quantization value q. A signal 
replacement portion 14 replaces q witii q' on the basis 
of the value of digital information to be embedded. A 
mean difference addition portion 15 subjects q' to 
inverse linear quantization using Q. to find a mean value 
M\ calculates a difference DM between M' and M. and 
adds tiie difference to the transform coefficients In tiie 
block. A mean calculation portion 16 calculates a mean 
value LM of the transform coefficients after the addition. 
A band synthesis portion 17 synthesizes tiie LL3 signal 
which has been subjected to the embedding processing 
and a signal in tiie otiier frequency band, to reconstruct 
an image signal 72. Further, the band division portion 
1 1 receives a digitized Image signal 71 , and divides the 
image signal 71 into 10 frequency bands by discrete 
wavelet ti^nsfomrr, to calculate transfomi coefficients. A 



map information generation portion 52 generates, witii 
respect to one of the 10 frequency bands, map informa- 
tion indicating whetiier or not the absolute amplitude 
values of all the transform coefficients in the same 
space representation region in the same direction of 
division as the frequency band are not more than a set 
value R. A signal replacement portion 53 refers to tiie 
value of each of the transform coefficients in the map 
information, and replaces, when the value of the trans- 
form coefficient is not more tiian the set value R, the 
value witti another value In accordance with tiie digital 
information to be embedded. A band synthesis portion 
17 synthesizes signals in ttie 10 frequency bands each 
including the replaced transform coefficients, to recon- 
struct an image signal 75. 
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Description 

BACKGROUND OF THE INVENTION 
5 Reld of the Invention 

[0001 ] The present invention relates generally to an apparatus for and a method of embedding and extracting digital 
information as well as a medium having a program for carrying out the method recorded thereon, and more particularly, 
to an apparatus for and a method of embedding. In order to protect the copyright of digital data, digital data such as 
10 copyright information (hereinafter referred to as digital information) in an image signal and extracting the embedded dig- 
ital information as well as a medium having a program for carrying out the method recorded thereon. 

Description of the Background Art 

IS [0002] In recent years, information utilizing the Intemet has been extensively provided. Particularly, WWW (World 
Wide Web) has been frequently utilized as an information transmitting and receiving service in which images, voices. 
arxJ so forth are integrated. 

[0003] However, digital information such as an image which is open to the public on a network of the Intemet can be 
easily copied by many and unspecified users. Therefore, some problems have arisen. For example, an image whose 
20 copyright is owned by a third person is secondarily utilized by making unauthorized copying thereof without the permis- 
sion of the copyright owner. Further, also in expanding the business on the Internet using image-based contents, meas- 
ures to prevent the unauthorized copying have been a problem. Therefore, the establishment of a technk^ue for 
protecting the copyright of an image signal has been demanded. 

[0004] An example of the measures conventionally known is an electron watermark technique. The digital watermark- 
25 ing is a technique for embedding digital infomnation in image data in a form which cannot be perceived by a human 
being. 

[0005] Examples of ttie conventional electron watermark technique include an electron watermark technk^ue using 
discrete wavelet transform described in an article entitled "Embedding a Signature to Picture under Wavelet Transfor- 
mation" by Matsui, Onishi, Nakamura et al. (Journal of The Institute of Electronics. Information and Communication 
30 Engineers D-ll VOL J79-D-II. No. 6. pp. 1017 to 1024. June 1996) (hereinafter referred to as a technk^ue by Matsui et 
al.), 

[0006] The technque by Matsui et al. will be described witii reference to Figs. 33 to 35. 
[0007] Description is now made of band division by discrete wavelet transform processing. 
[0008] Fig. 33 is a block diagram showing an example of the structure of a conventional band dividing device 1 1 for 
35 division into tiiree hierarchies. In Fig. 33, tiie conventional band dividing device 1 1 comprises first to third band divkJing 
filters 100, 200 and 300 having the same structure. Each of the first to third band dividing filters 100, 200 and 300 
divides a received image into four frequency bands, and calculates wavelet transform coeffnients (hereinafter merely 
referred to as transfbnm coefficients) for each of the frequency bands. 

[0009] It is also possible to obtain transform coefficients even by sub-band division which is equivalent to tiie band 

40 division by discrete wavelet transform, which is not described herein. 

[0010] The band divkiing device 1 1 inputs a digitized image signal 71 into tiie first band dividing fitter 100. The first 
band dividing filter 100 divides tiie image signal 71 into signals in four bands, i.e., an LL1 signal, an LHI signal, an HL1 
signal and an HH1 signal (hereinafter generically refen^ed to as a first hierarchical signal) on the basis of parameters of 
its horizontal and vertical frequency components. The second band divKling filter 200 receives tiie LL1 signal in the low- 

45 est band in the first hierarchksal signal, and further divkf es the LL1 signal into an LL2 signal, an LH2 signal, an HL2 sig- 
nal and an HH2 signal in four bands (hereinafter generically refened to as a second hierarchical signal). The third band 
dividing filter 300 receives the LL2 signal in the lowest band in tiie second hierarchical signal, and further divides tiie 
LL2 signal into an LL3 signal, an LH3 signal, an HL3 signal and an HH3 signal in four bands (hereinafter generically 
refen-ed to as a third hierarchical signal). 

so [0011] Rg. 34 is a block diagram showing an exanrple of tiie structure of the first band dividing filter 100. In Fig. 34, 
tiie first band divkling filter 1 GO comprises first to tiiird two-band division portions 1 01 to 1 03. The first to third two-band 
division portions 1 01 to 103 respectively comprise one-dimensional k}w-pass fitters (LPF) 1 1 1 to 1 1 3. one-dimensional 
high-pass filters (HPF) 121 to 123, and sub-samplers 131 to 133 and 141 to 143 for thinning a signal at a ratio of 2 : 1. 
[001 2] The first two-k>and division portion 1 01 receives the image signal 71 , and subjects the signal to low-pass f ilter- 

55 ing and high-pass filtering witii respect to its horizontal component by tiie LPF 1 1 1 and the HPF 121 , respectively, to 
output two signal. The signals obtained by the low-pass filtering and the high-pass filtering are respectively ttiinned at 
a ratio of 2 : 1 using ttie sub-samplers 131 and 141 . and are tiien outputted to the subsequent stage. Hie second two- 
band diviston portion 1 02 receives the signal from tiie sub-sampler 131. and filters ttie signal witii respect to its vertical 
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component by the LPF 1 12 and the HPF 122, respectively, thins the signal at a ratio of 2 : 1 using the sub-samplers 132 
and 1 42, and then outputs two signals, i. e., an LL signal and an LH signal. On the other hand, the third two-band divi- 
sion portion 103 receives the signal from the sub-sampler 1 41 . and respectively filters the signal with respect to its ver- 
tical component by the LPF 113 and the HPF 123, thins the signal at a ratio of 2 : 1 using the sub-samplers 133 and 

5 143. and then outputs two signals, i.e.. an HL signal and an HH signal. 

[0013] Consequently, four signals, I.e., the LLI signal which is low in both its horizontal and vertical components, the 
LH1 signal which is low in its horizontal component and is high in its vertical component, the HL1 signal which is high 
in its horizontal component and is low in its vertical component, and the HH1 signal which is high in both its horizontal 
and vertical components, that is, transform coefficients are outputted from the first band-dividing filter 100. 

10 [0014] The second and third band dividing filters 200 and 300 also respectively subject received signals to the same 
processing as described above. 

[001 5] As a result of the band division processing by the first to third band dividing filters 1 00. 200 and 300. the image 
signal 71 is divided into 10 band signals, i.e.. an LL3 signal, an LH3 signal, an HL3 signal, an HH3 signal, an LH2 signal, 
an HL2 signal, an HH2 signal, an LH1 signal, an HL1 signal and an HH1 signal. Fig. 35 is a diagram showing represen- 
ts tation of the signals by a two-dimensional frequency region. 

[001 6] In Fig. 35. the vertical axis represents a vertical frequency component, which increases as it is directed down- 
ward, and the horizontal a3d8 represents a horizontal frequency component, which inaeases as It Is directed rightward. 
Each of regions In Fig. 35 is data serving as one image, and the area ratio of the regions coincides with the ratio of the 
respective numbers of data in the band signals. That is, in a case where the number of data In the LL3 signal, the LH3 
20 signal, the HL3 signal and the HH3 signal which are the third hierarchical signal is taken as one. the number of data in 
the LH2 signal, the HL2 signal and the HH2 signal which are the second hierarchical signal is four, and the number of 
data in the LH1 signal, the HL1 signal and the HH1 signal which are the first hierarchical signal is 16. Consequently, 
with respect to one data at the upper left of the LL3 signal, for example, one data at the upper left of each of the LH3 
signal, the HL3 signal and the HH3 signal, fbur data, which are square, at the upper left of each of the Lhl2 signal, the 
25 HL2 signal and the HI-12 signal. 16 data, which are square, at the upper left of each of the LH1 signal, the HL1 signal 
and the HH1 signal represent the same pixel on an original image (portions painted in black in Fig. 35). 
[001 7] Description is now made of a method of embedding digital information after the above-mentioned band division 
by discrete wavelet transform. The embedding method Itself described below is a technique welt-known by those skilled 
in the art. Matsui et al. realize digital watermarking by combining the discrete wavelet transform and the conventional 
30 embedding method. 

[0018] The conventional enf4)edding method utilizes visual characteristics of a human being who easily overlooks 

noise in a high frequency region and easily detects noise in a low frequency region. That is, in an image signal, energy 
is concentrated in its low frequency component. Therefore, in output components in the discrete wavelet transform, an 
LL signal representing a low frequency component of the image signal is an important band component. On the other 

35 hand, three types of signals, i.e., an LH signal, an HL signal and an HH signal representing high frequency components, 
shown in multi-resolution representation (MRR), of the image signal are not so important band components. 
[0019] With respect to each of the MRR conponents, i.e., the LH signal, the HL signal and the HH signal, which are 
not so important, the logtoal value of the low-order bit (least significant bit (LSB) if possit)le) of a wavelet transform coef- 
ficient which is not zero out of u^elet transform coefficients in the MRR component is transformed in accordance with 

40 the value of a bit, in digital information, to be embedded on the basis of previously determined regularity, to perform dig- 
ital watermarking. 

[0020] In the technique by Matsui et al., the digital information is embedded in only the MRR components which are 
high frequency oomponents of an image calculated by the discrete wavelet transform and the low-order bits thereof 
which hardly affect the change in the image. Therefore, the degradation of the quality of an Innage reconstructed by the 
45 signal in which the digital information has been embedded is so slight as not to be perceived with the eyes of a human 
being. 

[0021] In the case of display and distribution, for example, on a networK the signals in the respective frequency bands 
which have been subjected to the above-mentioned embedding processing are synthesized by a band synthesizing 
device (In short, performing processing reverse to the discrete wavelet transform), to reconstruct an image signal. Fur- 
so ther, in order to extract the embedded digital information from the reconstructed image signal, the discrete wavelet 
transform is performed to extract the logical values transformed in the embedding processing. 
[0022] In the above-mentioned technique by Matsui et al., however, the digital informatfon Is embedded in the MRR 
components which are high frequency components of the image, the following problems remain. 

55 (1) By frequency-transforming the image in which the digital information has been embedded, and then rewriting 
and cutting the high frequency components of the iamge, the embedded digital information can be removed rela- 
tively simply. 

(2) Even by subjecting the image in which the digital information has been embedded to low-pass filtering, the high 
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frequency components of the image are reduced, so that the embedded digital information Is lost. 
(3) Furthermore, in image communication, for example, the image is transmitted upon being compressed. In the 
case, the high frequency components of the transform coefficients of the image are generally coarsely quantized 
to perform irreversible compression, so that the effect on the high frequency components of the Image is increased. 
5 That Is. the respective lower-order bits of the transform coefficients In the MRR componerrts of the image are sig- 
nificantly changed, so that the embedded digital information cannot be con-ectly extracted. 

SUMMARY OF THE INVENTION 

10 [0023] Therefore, an object of the present invention is to provide an apparatus for and a method of embedding and 
extracting digital information, in which it is possible to reliably extract, by embedding digital information in not only trans- 
form coefficients having high frequency components of an image but also transform coefficients having low frequency 
components which dgrade the quality of the image at the time of extracting the embedded digital information and further 
embedding the digital information only in transform coefficients having not the high frequency components but the low 

IS frequency components, the embedded digital information without losing the information against the above-mentioned 
attadt from an unauthorized user, and the quality of the iamge is hardly degraded at the time of extracting the embed- 
ded digital infonnation, and a medium having a program for canying out the method recorded thereon. 
[0024] In order to attain the akx)ve-mentioned object, the present invention has the following features. 
[0025] A first aspect is directed to a digital information embedding apparatus for embedding inherent digital infbrma- 

20 tion in a digital image signal, comprising: 

band division means for dividing the digital image signal Into transform coefficients over a plurality of frequency 
bands using ^er discrete wavelet transform or sub-band division; 

block division means for dividing the lowest frequency band out of the plurality of frequency bands obtained by the 
2B division into a plurality of blocks in accordance with a previously determined block size; 

quantization means for calculating for each of the blocks a mean value M of the transform coefficients in the t>lock. 
and subjecting the mean value M to linear quantization using a previously determined quarrtization step-size Q (Q 
is an integer of not less than one), to calculate a quantization value; 

signal replacement means for replacing for each of the blocks, on the basis of the quantization value and the value 
30 of the digital information to be embedded which correspond to the block, the quantization value; 

mean difference addition means for subjecting for each of the blocks the replaced quantization value to inverse lin- 
ear quantization using the quantization step-size Q to calculate a mean value M\ and adding a difference DM (a M' 
- M) between the mean value M' and the mean value M to all the transform coefficients in the t)lock; 
mean calculation means for calculating a mean value LM of the transform coefficients In the lowest frequency band 
35 after the addition of the difference DM ; and 

band synthesis means for reconstructing a digital image signal in which the digital information has been embedded 
using the lowest frequency band after the addition of the difference DM and the other frequency bands. 

[0026] As described in the foregoing, according to the first aspect, the digital information is embedded in the transform 
40 coefficients in the lowest frequency band using either the discrete wavelet transform or the sub-band division. Conse- 
quently, it is possible to prevent the embedded digital information fifom being lost against an attack for unauthorized uti- 
lization from a third person. 

[0027] A second aspect is directed to a digital infbrmatk)n embedding apparatus for embedding inherent digital infor- 
matk>n in a digital image signal, comprising: 

45 

orthogonal transform means for dividing the digital image signal into a plurality of blocks each composed of a plu- 
rality of pixels previously determined, and subjecting, for each of the blocks, the block to orthogonal transform, to 
calculate transform coefficients; 

block selection means for further classifying the plurality of blocks obtained by the division into groups each com- 
50 prising one or two or more blocks in accordance with a previously determined number of blocks; 

quantization means for extracting, for each of the blocks belonging to each of the groups, the transform coefficient 
having the lowest frequency component (hereinafter referred to as a DC component) out of the transform coeffi- 
cients in the block and calculating a mean value M of the respective DC components in the blocks, and subjecting 
the mean value M to linear quantization using a previously determined quantization step-size Q (Q is an integer of 
55 not less than one), to calculate a quantization value; 

signal replacement means for replacing for each of the groups, on the basis of the quantization value and the value 

of the digital infornfiation to be emt>6dded which con'espond to the group, the quantization value; 

ntean difference addition means for subjecting for each of the groups the replaced quantization value to inverse lln- 
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ear quantization using the quantization step-size Q to calculate a mean value M', and adding a difference DM (= M' 

- M) between the mean value M' and the mean value M to all the DC components in the blocks belonging to the 
group: 

inverse orthogonal translbrnfi means for subjecting the plurality of blocks after the addition of the difference DM to 
5 inverse orthogonal transform, to reconstruct a digital image signal in which the digital information has been emt>ed- 
ded; and 

mean calculation means for calculating a mean value LM of the amplitude values of the pixels in the reconstructed 
digital image signal. 

10 [0Q28] As desaibed in the foregoing, according to the second aspect, the digital information is embedded only in the 
lowest frequency conrponent using the orthogonal transform. Consequently, it is possible to prevent the embedded cGg- 
ital infornfiation from being lost against an attack for unauthorized utilization from a third person. 
[0029] A third aspect is characterized in that in the second aspect, the orthogonal transform means perfbmfis signal 
transformation which is any one of discrete cosine transform. Fourier transform and Hadamard transform. 

75 [0030] As described in the foregoing, according to the third aspect, the typical system of the signal transtormatfon 
performed by the orthogonal transform means in the second aspect is specified. 

[0031] A fourth aspect is directed to a digital information embedding apparatus for embedding inherent digital infor- 
matfon in a digital Image signal, comprising: 

20 btod( selection means for dividing the digital image signal Into a plurality of bfocks each oorrposed of a plurality off 
pixels previously determined; 

quantization means for calculating for each of the blocks a mean value M of the pixels composing the block, and 
subjecting the mean value M to linear quantization using a previously determined quantization step-size Q (Q is an 
Integer of not less than one), to calculate a quantization value; 
25 signal replacement means for replacing for each of the blocks, on the basis of the quantization value £md the value 
of the digital information to be embedded which correspond to the block, the quantization value; 
mean difference addition means for subjecting for each of the blocks the replaced quantization value to inverse lin- 
ear quantization using the quantization step-size Q to calculate a mean value M', and adding a difference DM (= M* 

- M) between the mean value M' and the mean value M to all the pixels composing the block; and 

30 mean calculation means for calculating a mean value LM of the amplitude values of the pixels in the digital image 
signal after the addition of the difference DM. 

[0032] As desaibed in the foregoing, according to the fourth aspect, the digital information is embedded in the mean 
value of the pixels composing the blocK that is, the lowest frequency component. Consequentiy it is possible to prevent 
35 the embedded digital information from being lost against an attack for unauthorized utilization from a third person. 
[0033] A fifth aspect is characterized in that in the first aspect, 

the signal replacement means replaces the quantization value with an odd value closest to the value of (M/Q) when 
each of bits composing tiie digital information takes a logical value 1 , while replacing the quantization value witii an 
40 even value closest to the value of (M/Q) when the bit takes a logical value 0. 

[0034] A sixtii aspect is characterized in that in the second aspect, 

tiie signal replacement means replaces the quantization value witii an odd value closest to the value of (M/Q) when 
45 each of bits composing tiie digital Infbrmation takes a logical value 1 , while replacing the quantization value witti an 
even value closest to tiie value of (M/Q) when the bit takes a logical value 0. 

[0035] A seventii aspect Is characterized in that In the tiiird aspect. . 

so the signal replacement means replaces tiie quantization value witii an odd value closest to the value of (M/Q) when 
each of bits composing tiie digital information takes a fogical value 1 , while replacing tiie quantization value witii an 
even value closest to the value of (M/Q) when the bit takes a logical value 0. 

[0036] An eighth aspect is characterized in that in the fourth aspect, 

55 

the signal replacement means replaces ttie quantization value witii an odd value closest to the value of (M/Q) when 
each of bits composing tiie digital Information takes a fogical value 1 , while replacing tiie quantization value witii an 
even value closest to the value of (M/Q) when the bit takes a logical value 0. 



6 



EP0920185A2 

[0037] As described in the foregoing, according to the fifth to eighth aspects, the quantization value is replaced with 
the odd or even value closest to the value of (M/Q) on the basis of the logical value of each of the bits composing the 
digital information in the first to fourth aspects. Consequently, it is possible to reduce the degradation of the image at 
the time of extracting the embedded digital information, and it is difficult for a third person to detect the embedded digital 
5 information. 

[0038] A ninth aspect is directed to a digital information extracting apparatus for extracting inherent digital information 
embedded by a particular apparatus in transform coefficients in the lowest frequency band obtained by dividing a digital 
image signal using either discrete wavelet transform or sub-band division, wherein the digital Image signal outputted by 
the particular apparatus and a quantization step-size are inputted, comprising: 

10 

band division means for dividing the digital Image signal into transform coefficients over a plurality of frequency 
bands using either discrete wavelet transform or sut)-band division; 

block division means for dividing the lowest frequency band out of the plurality of frequency bands obtained by the 
division into a plurality of blocks in accordance with a previously determined block size; 
IS quantization means for calculating for each of the blocks a mean value M of the transform coefficients in the biocK 
and subjecting the mean value M to linear quantization using the previously determined quantization step-size Q, 
to calculate a quantization value; and 

digital information judgment means for judging whether the quantization value is even or odd, to extract the embed- 
ded digital information on the basis of the results of the judgment. 

20 

[0039] As described in the foregoing, according to the ninth aspect, the logical value of the embedded digital Informa- 
tion is judged by the results of extracting the transform coefficients which have been embedded in the lowest frequency 
band which is hardly affected by data destruction in high frequency bands, and calculating the quantization value of the 
mean value of the transform coefficients In each of the blocks in the tow frequency band using a prevtously detennined 
25 method. Consequently, accurate digital information can be extracted without being affected by an attack from an unau- 
thorized user. 

[0040] A tenth aspect Is directed to a digital information extracting appai atus for extracting inherent digital information 
embedded by a particular apparatus in transform coefficients in the lowest frequency band obtained by dividing a digital 
image signal using either discrete wavelet transform or sub-band division, wherein the digital image signal outputted by 
30 the particular apparatus, a quantization step-size, and a mean value LM of the transform coefficients in the lowest fre- 
quency band at the time of output are Inputted, comprising: 

band divlsfon means for dividing the digital image signal into transform coefficients over a plurality of frequency 
bands using either discrete wavelet transform or sut>-band division; 
35 mean difference sut>traction means for calculating a mean value LM' of the transform coefficients in the lowest fre- 
quency band out of the plurality of frequency bands obtained by the division, and subtracting a difference DM (= 
LM* - LM) between the mean value LM' and the mean value LM from all the transform coefficients in the lowest fre- 
quency band; 

block division means for dividing the lowest frequency band after the subtraction of the difference DL into a plurality 
40 of blocks in accordance with a previously determined block size; 

quantization means for calculating for each of the blocks a mean value M of the transform coefficients in the blocK 
and subjecting the mean value M to linear quantization using the quantization step-size Q, to calculate a quantiza- 
tion value; and 

digital information judgment means for judging whether the quantization value is even or odd, to extract the embed- 
45 ded digital infonnation on the basis of ttie results of the judgment. 

[0041 ] As described in the foregoing, according to the tenth aspect, the logical value of the embedded digital informa- 
tion is judged by the results of calculating, with respect to the lowest frequency band including the transform coefficients 
whose mean value is corrected using the mean values LM' and LM even when it is changed by image processing such 
so as irreversible conpression, the quantization value of the mean value of the transform coefficients in each of the blocks 
In ttie low frequency band using a previously determined method. Consequently, wore accurate digital Information can 
be extracted without being affected by an attack from an unauthorized user. 

[0042] An eleventh aspect is directed to a digital information extracting apparatus for extracting inherent digital infor- 
mation embedded by a particular apparatus in transform coefficients obtained by subjecting a digital image signal to 
55 signal transformation which is any one of discrete cosine transform, Fourier transform and Hadamard transform, then 
dividing the digital image signal into blocks, and subjecting each of the blocks to orthogonal transform, wherein the dig- 
ital Image signal outputted by the particular apparatus and a quantization step-size are inputted, comprising: 
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orthogonal transform means for dividing the digital image signal into a plurality of blocks each composed of a plu- 
rality of pixels previously determined, and subjecting, for each of the blocks, the block to orthogonal transform, to 
calculate transform coefficients; 

block selection means fbr further classifying the plurality of blocks obtained by the division into groups each oom- 
5 prising one or two or more blocks In accordance with a previously determined number of blocks; 

quantization means for calculating for each of the groups a mean value of the respective transform coefficients hav- 
ing the lowest frequency components In the blocks belonging to the group, and subjecting the mean value to linear 
quantization using the previously determined quantization step-size, to calculate a quantization value; and 
digital information judgment means for judging whether the quantization value is even or odd, to extract the embed- 
10 ded digital information on the basis of the results of the judgment 

[0043] As described in the foregoing, according to the eleventh aspect, the logical value of the embedded digital infor- 
mation is judged by the results of extracting the transform coefficient which has been embedded In the lowest frequency 
component which is hardly affected by data destruction In high frequency bands, and calculating the quantization value 
15 of the mean value of the respective transform coefficients having the lowest frequency components in the plurality of 
blocks using a previously determined method. Consequently, accurate digital information can be extracted without 
being affected by an attack from an unauthorized user. 

[0044] A Iwelftti aspect is directed to a digital information extracting apparatus for extracting Inherent digital informa- 
tion embedded by a particular apparatus in transform coefficients obtained by subjecting a digital image signal to signal 
20 transformation which is any one of discrete cosine transform, Fourier transform and Hadamard transform, then dividing 
the digital image signal into blocks, and subjecting each of the blocks to orthogonal transform, wherein the digital image 
signal outputted by the particular apparatus, a quantization step-size, and a mean value LM of the anplitude values of 
pixels in the cfigital image signal at the time of output are inputted, comprising: 

25 mean difference subtraction means for calculating a mean value LM' of the arnplitude values of the pixels In the dig- 
ital Image signal at the time of input, and subtracting a difference DM (= LM' - LM) between the mean value LM* and 
the mean value LM from the values of all the pixels In the digital image signal; 

orthogonal transform means fbr dividing the digital Image signal after the subtraction of the difference DL into a plu- 
rality of blocks each composed of a plurality of pixels previously determined, and subjecting, fbr each of the blocks, 

30 the block to orthogonal transform, to cateulate transform coefficients; 

block selection means for further classifying the plurality of blocte obtained by the division into groups each com- 
prising one or two or more blocks in accordance with a previously determined number of blocks; 
quantization means for calculating for each of the groups a mean value of the respective transform coefficients hav- 
ing the lowest frequency components in the blocks belonging to the group, and subjecting the mean value to linear 

35 quantization using the previously determined quantization step-size, to calculate a quantization value; and 

digital information judgment mears for judging whether the quantization value is even or odd, to extract the embed- 
ded digital information on the basis of the results of the judgment. 

[0045] As desalbed in the foregoing, according to the twelfth aspect, the logical value of the embedded digital infor- 
40 nation is judged by the results of calculating, with respect to the lowest frequency component. In the digital image sig- 
nal, including the transform coefficients whose mean value is corrected using the mean values LM' and LM of the 
amplitude values of the pixels in the digital image signal even when It is changed by Image processing such as irrevers- 
ible compression, the quantization value of the mean value of the respective transform coefficients having the kswest 
frequency oomponents in the plurality of blocks using a previously determined method. Consequently, more accurate 
45 digital Infomiatfon can be extracted without being affected by an attack from an unauthorized user. 

[0046] A thirteenth aspect is directed to a digital Information extracting apparatus for extracting Inherent digital Infor- 
mation embedded by a particular apparatus in a mean value of pixels composing each of blocks obtained by dividing a 
digital image signal, wherein the digital Image signal outputted by the particular apparatus and a quantization step-size 
are Inputted, comprising: 

50 

block selection means tor dividing the digital image signal into a plurality of blocks each composed of a plurality of 
pixels previously determined: 

quantization means fbr calculating for each of the blocks a mean value of the pixels composing the block, and sub- 
jecting the mean value to linear quantization using the quantization step-size, to calculate a quantization value; and 
ss digital information judgment means for judging whether the quantization value is even or odd, to extract the embed- 
ded digital information on the basis of the results of the judgment. 

[0047] As described in the foregoing, according to the thirteenth aspect, the logical value of the emt)edded digital 
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information is judged by the results of extracting the mean value of the pixels composing the block which is hardly 
affected by data destruction in high frequency bands, and calculating the quantization value of the mean value using a 
previously detemiined method. Consequently, accurate digital information can be extracted without being affected by 
an attack from an unauthorized user. 
5 [0048] A fourteenth aspect is directed to a digital information extracting apparatus for extracting inherent digital infbr- 
mation embedded by a particular apparatus in a mean value of pixels composing each of blocks obtained by dividing a 
digital image signal, wherein the digital image signal outputted by the particular apparatus, a quantization step-size, and 
a mean value LM of the amplitude values of the pixels in the digital image signal at the time of output are inputted, com- 
prising: 

70 

mean difference subtraction means for calculating a mean value LM* of the amplitude values of the pixels in the dig- 
ital image signal at the time of input, .and subtracting a difference DL (=LM'- LM) between the mean value LM' and 
the mean value LM from the values of all the pixels in the digital image signal; 

block selection means for dividing the digital image signal after the subtraction of the difference DL into a plurality 
15 of blocks each composed of a plurality of pixels pre/iously determined; 

quantization means for calculating a mean value of the pixels composing each of the blocks obtained by the divi- 
sion, and subjecting the mean value to linear quantization using the quantization step-size, to calculate a quantiza- 
tton value; and 

digrtal information judgment means for judging whether the quantizatton value is even or odd. to extract the embed- 
20 ded digital information on the basis of the results of the judgment. 

[0049] As described in the foregoing, according to the fourteenth aspect, the logical value of the embedded digital 
Information is judged by the results of calculating, with respect to the digital image signal including blocks each com- 
posed of the pixels whose mean value Is con'ected using the mean values LM* and LM of the amplitude values of the 
25 pixels in the digital image signal even when it is changed by image processing such as irreversible compression, the 
quantization value of the mean value of the pixels composing the block using a previously determined method. Conse- 
quently, accurate digital information can be extracted without being affected by an attack from an unauthorized user. 
[0050] A fifteenth aspect is directed to a digital information embedding apparatus for embedding inherent digital infor- 
mation in a digital image signal, comprising: 

30 

band division means for dividing the digital image signal into transform coefficients over a plurality of frequency 
bands using either discrete wavelet transform or sut)-band division: 

map information generation means for generating, with respect to each of the transform coefficients included in the 
one or two frequency bands out of the plurality of frequency bands obtained by the division, map information storing 

35 a trueAialse value based on decision whether or not all the at>solute amplitude values of the transform coefficient 
and the other transform coefficients in the same space representation region in the same direction of division as 
the one or two frelquency bands are not more than a previously determined set value; 
signal replacement means for replacing all of the transform coefficient and the other transform coefficients which 
correspond to the position where the true/false value of the map information is true with a previously determined 

40 transform value on the basis of the value of the digital information to be embedded in the transform coefficients; and 
band synthesis means for synthesizing the plurality of transform coefficients after the replacement, to reconstruct 
a digital image signal. 

[0051] As described in the foregoing, according to the fifteenth aspect, the digital information is embedded in the fre- 
45 quency signal over a plurality of hierarchies using either the discrete wavelet transfbnri or the sub-band division. Con- 
sequently, it is possible to prevent the embedded digital information from being lost against an attack for unauthorized 
utilization from a third person. 

[0052] A sixteenth aspect is characterized in that in the fifteenth aspect, 

so the transfionm value is set to integers ± K which are not more than the set value, and 

the signal replacement means replaces the transform coefficient and the other transform coefficients with the trans- 
form value + K when each of bits composing the digital information takes a logical value 1 , while replacing the trans- 
form coefficients with the transform value - K when the bit takes a logical value 0. 

55 [0053] As described in the foregoing, according to the sixteenth aspect, the transform coefficient whose absolute 
anplitude value is not more than the set value is replaced with the transform values ± K which are set to not more than 
the set value. Consequently, it is possible to reduce the effect on the degradatbn of the image at the time of extracting 
the embedded digital Information, and it is difficult for a third person to detect the embedded digital information. 
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[0054] A seventeenth aspect is characterized in that In the fifteenth aspect, 

the map information generation means generates the map information with respect to the transform ooeffidents 
included in at least one or both of the frequency band which is low in its horizontal component and is high in its ver- 
5 tical component and the frequency band which is high in its horizontal component and is low in its vertical compo- 
nent 

[OOSq An eighteenth aspect is characterized in that in the sixteenth aspect. 

10 the map infonnation generation means generates the map information with respect to the transform coefficients 
included in at least one or both of the frequency band which is low in its horizontal component and is high in its ver- 
tical component and the frequency band which is high In its horizontal component and is low in its vertical compo- 
nent 

IS [0056] As described in the foregoing, according to the seventeenth and eighteenth aspects, the digital information Is 
embedded in the frequency signal having the lower frequency component in the fifteenth and sixteenth aspects. Con- 
sequently, It is possible to further prevent the embedded digital information from being tost against an attack for unau- 
thorized utilization from a third person. 

[0057] A nineteenth aspect is directed to a digital information embedding apparatus for embedding inherent digital 
20 information in a digital image signal, comprising: 

band division means for dividing the digital image signal into transfer coefficients over a plurality of frequency bands 
using either discrete wavelet transform or sub-t)and division; 

map information generation means for generating, with respect to each of the transform coefficients Included in the 
2S one or two frequency bands out of the plurality of frequency bands obtained by the division, map Information storing 
a true/false value based on decision whether or not the absolute amplitude value of the transform coefficient is 
Included between upper-limit and lower-limit threshold values which are previously determined; 
signal replacement means for r^lacing the transform coefficient corresponding to the position wh^-e the true/ialse 
value of the map information is true with a previously determined transform value on the basis of the sign of the 
30 transform coefficient and the value of the digital information to be embedded in tiie transform coefficient; and 

band synthesis means for synthesizing the plurality of transform coefficients after tiie replacement, to reconstruct 
a digital image signal. 

[0058] As desaibed In the foregoing, according to the nineteenth aspect, the digital information is embedded only In 
the transform coefficients in a deep hierarchical signal which is hardly affected using tiie discrete wavelet transform or 
the sub-band division. Consequentiy, it Is possible to furtiier prevent the embedded digital information from being lost 
against an attack for unauttiorized utilization from a third person. 

[0059] A twentietti aspect is directed to a digital infbrmation embedding apparatus for embedding inherent digital infor- 
mation in a digital image signal, comprising: 

orthogonal transform means for dividing the digital image signal into a plurality of block signals of a previously 
determined size, and sut)jecting, for each of the block signals, the block signal to orthogonal transform, to calculate 
transform coefficients; 

map infbrmation generation means for generating, witii respect to each of the transform coefficients included in tiie 
one or two block signals out of the plurality of block signals obtained by tfie division, map information storing a 
true/lalse value based on decision whether or not the absolute amplitude value of tiie transform coefficient is 
included between upp^-limit and lower-limit tiireshotd values which are previously determined; 
signal replacement means for replacing tiie transform coefficient corresponding to tiie position where tiie true/false 
value of ttie map information is true witii a previously determined transform value on the basis of the sign of the 
transform coefficient and tiie value of tiie digital information to be embedded in tiie transform coefficient; and 
inverse ortiiogonal transform means for subjecting tiie plurality of transform coefffoients after tiie replacement to 
inverse ortiiogonal transform, to reconstruct a digital image signal. 

[0060] As described in tiie foregoing, according to the twentieth aspect, tiie digital information Is embedded only in 
S5 the transform coefficients in a deep hierarchical signal which is hardly affected using the orthogonal transform. Conse- 
quentiy, it is possible to further prevent the embedded digital information from being lost against an attack for unautiior- 
ized utilization from a third person. 

[0061] A twenty-first aspect is characterized in that in tiie twentietti aspect, 
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the orthogonal transform means performs frequency transformation which is any one of discrete cosine transfbmi, 
Fourier transform and Hadamard transform. 

[0062] As desaibed in the foregoing, according to the twenty-first aspect, the typical system of the frequency trans- 
5 formation performed l3y the orthogonal transform means in the twentieth aspect is specified. 
[0063] A twenty-second aspect is characterized in that in the nineteenth aspect, 

the transform value is set to integers ± A and ± B between the upper-limit and iower-limrt threshold values, and 
the signal replacement means replaces the transform coefficient with the transform value -i- A when each of bits 
10 composing the digital Information takes a logical value 1 and the sign of the transform coefficient is positive, with 
the transform value - A when the bit takes a logical value 1 and the sign of the transform coefficient is negative, with 
the transfonm value -i- B when the bit lakes a logical value 0 and the sign of the transform coefficient is positive, and 
with the transform value ■ B when the bit takes a logical value 0 and the sign of the transform coefficient is negative. 

IS [0064] A twenty-third aspect is characterized in that in the twentieth aspect, 

the transform value is set to integers ± A and ± B between the upper-limit and lower-limit threshold values, and 
the signal replacement means replaces the transform coefficient with the transform value -h A when each of bits 
composing the digital information takes a logical value 1 and the sign of the transform coefficient is positive, with 
20 the transform value - A when the bit takes a logical value 1 and the sign of the transform coefficient is negative, with 
the transform value -i- B when the bit takes a logical value 0 and the sign of the transform coefficient is positive, and 
with the transform value - B when the bit tal^ a logical value 0 and the sign of the transform coefficient is negative. 

[0065] A twenty-fourth aspect is characterized in that In the twenty-first aspect, 

2S 

the transform value is set to integers ± A and ± B between the upper-limit and lower-limit threshold values, and 
the signal replacement means replaces the transform coefficient with the transform value + A when each of bits 
composing the digital information takes a logical value 1 and the sign of the transform coefficient is positive, with 
the transform value - A when the bit takes a logical value 1 and the sign of the transform coefficient is negative, with 
30 the transform value + B when the bit takes a logical value 0 and the sign of the transform coefficient is positive, and 
with the transform value - B when the bit takes a logical value 0 and the sign of the transform coefficient is negative. 

[0066] As described in the foregoing, according to the twenty-second to twenty-fourth aspects, the transform coeffi- 
cient whose absolute amplitude value is within the threshold range is transformed into and replaced with a value within 
35 the threshold range considering the sign of the transform coefficient. Consequently, it is possible to reduce the effect on 
the degradation of the image at the time of extracting the embedded digital information, and it is difficult for a third per- 
son to detect the embedded digital information. 

[0067] A twenty-fifth aspect is characterized in that in the nineteenth aspect, 

40 the map information generation means generates the map information with respect to the respective transform 
coefficients having the low frequency components other than the DC conponents. 

[0068] A ^enty-sixth aspect is characterized in that in the twentieth aspect, 

45 the map infbrmation generation means generates the map information with respect to the respective transfbrm 
coefficients having the low frequency components other than the DC components. 

[0069] A twenty-seventh aspect is characterized in that in the twenty-first aspect, 

so the map information generation means generates the map infbrmation with respect to the respective transfbrm 
coefficients having the low frequency components other than the DC components. 

[0070] A twenty-eighth aspect is characterized in that in the twenty-second aspect. 

55 the map infbrmation generation means generates the map information with respect to the respective transfbrm 
coefficients having the low frequency components other than the DC components 

[0071 ] A bventy-ninth aspect is characterized in that in the twenty-third aspect. 
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the map information generation means generates the map information with respect to the respective transform 
coefficients having the low frequency components other than the DC components. 

[0072] A thirtieth aspect is characterized in that in the twenty-fourth aspect, 

5 

the map infbrmation generation means generates the map information with respect to the respective transform 
coefficients having the low frequency components other than the DC components. 

[0073] As desCTibed In the foregoing, according to the twenty-fifth to thirtieth aspects, the digital information is embed- 
10 ded in the frequency signal having the lower frequency component in the nineteenth to twenty-fourth aspects. Conse- 
quently, it is possible to further prevent the embedded digital infbrmation from being lost against an attack for 
unauthorized utilization from a third person. 

[0074] A thirty-first aspect is directed to a digital infbmiation extracting apparatus for extracting inherent digital infbr- 
mation embedded by a particular apparatus in transform coefficients obtained by dividing a digital image signal using 
IS either discrete wavelet transform or sub-band division, wherein the digital image signal outputted by the particular appa- 
ratus and map infbrmation representing the position where the digital Information is embedded are inputted, compris- 
ing: 

band division means for dividing the digital image signal into transform coefficients over a plurality of frequency 
20 bands using either discrete wavelet transform or sub-band division; 

map infomiation analysis means for extracting, on the basis of the map Infbrmation. the transform coefficient cor- 
responding to the position where a true/false value of the map information is true and tiie other transform coeffi- 
cients in the same space representation region In the same direction of division as the frequency band including 
the transform coefficient; 

25 coefficient calculation means for calculating a total value of the transform coefficients included in the one or two or 
more frequency bands out of the transform coefficient and the other transform coefficients which are extracted; and 
digital information judgment means for judging the sign of the total value, to extract tiie embedded digital informa- 
tion on the basis of the results of the judgment. 

so [0075] As described In the foregoing, acx^ording to the thirty-first aspect, the logical value of tiie embedded digital 
information is judged by the results of extracting the transform coefficients which have been embedded in the low fre- 
quency band which is hardly affected by data destruction in high frequency bands, and calculating tiie total value of the 
transform coefficients using a previously determined method. Consequently, accurate digital infbrmation can be 
extracted without being affected by an attack from an unauttiorized user. 

35 [0076] A tiiirty-second aspect Is directed to a digital information extracting apparatus for extracting inherent digital 
Information embedded by a particular apparatus in transform coefficients obtained by dividing a digital image signal 
using eltiier discrete wavelet transform or sub-band division, wherein tiie digital image signal outputted by the particular 
apparatus, map infbrmation representing the position where the digital infbrmation is embedded, and information rep- 
resenting a transform value to be embedded are inputted, comprising: 

40 

band division means for dividing the image signal into transform coefficients over a plurality of frequency bands 
using either discrete wavelet transform or sub-band division; 

map information analysis means for extracting, on the basis of tiie map information, the transform coefficient cor- 
responding to the position where a true/false value of tiie map Infbrmation Is f ue; 
45 error calculation means for calculating an absolute error between tiie extracted transform coefficient and the trans- 
form value: and 

digital infomnation judgment means for judging the absolute error, to extract the embedded digital infbrmation on 
tiie basis of the results of the judgment. 

50 [0077] As described in tiie foregoing, according to the thirty-second aspect, the logical value of tiie embedded digital 
information is judged by the results of extracting the transform coefficient which has been embedded in a deep hierar- 
chical signal which is not affected by data destruction in high frequency bands, and calculating and judging the absolute 
error between the ti'ansfbrm coefficient and the transform value using a previously determined metiiod. Consequentty, 
accurate digital information can be extiacted witiiout being affected by an attack from an unauthorized user. 

55 [0078] A thirty-third aspect is directed to a digital information extracting apparatus for extracting inherent digital Infor- 
mation embedded by a particular apparatus in transform coefficients obtained by subjecting a digital image signal to fre- 
quency transformation which is any one of discrete cosine transform. Fourier ti^ansform and Hadamard ti'ansfbrm, tiien 
dividing the digital image signal into blocks, and subjecting each of the blocks to ortiiogonal transform, wherein the dig- 
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Ital image signal outputted by the particular apparatus, map information representing the position where the digital infor- 
mation is embedded, and information representing a transform value to be embedded are inputted, comprising: 

orthogonal transform means for dividing the digital image signal into a plurality of block signals of a previously 
5 determined size, and subjecting, for each of the block signals, the block signal to ortiiogonal transform, to calculate 
transform coefficients: 

map information analysis means for extracting, on the basis of the map information, the transform coefficient cor- 
responding to tiie position where a true/false value of the map information is true; 

enror calculation means for calculating an absolute error between the extracted transform coefficient and the trans- 
10 form value; and 

digital information judgment means for judging the absolute error, to extract the embedded digital information on 
the basis of the results of the judgment. 

[0079] As described in the foregoing, according to the tiiirty-third aspect, the logical value of the embedded digital 
15 information is judged by ttie results of extracting tiie transform coefficient which has been embedded in a deep hierar- 
chical signal which is not affected by data destruction in high frequency bands and calculating and judging the absolute 
error between the transform coefficient and the transfonn value using a previously determined method. Consequentiy, 
accurate digital information can be extracted without being affected by an attack from an unautiiorized user. 
[0080] A thirty-fourth aspect is directed to a digital information embedding method of embedding inherent digital infor- 
20 matton In a digital image signal, comprising the steps of: 

dividing the digital image signal into transform coefficients over a plurality of frequency bands using either discrete 
wavelet transform or sub-band division; 

dividing the lowest frequency band out of tiie plurality of frequency bands obtained by the division into a plurality of 
25 blocks in accordance with a previously determined block size; 

calculating for each of tiie blocks a mean value M of the transform coefficients in the blocK and subjecting tiie mean 
value M to linear quantization using a previously determined quantization step-size Q (Q Is an Integer of not less 
than one), to calculate a quantization value; 

replacing for each of tiie blocks, on the basis of the quantization value and the value of the digital information to be 
30 embedded which correspond to tiie blocK the quantization value; 

subjecting for each of the blocks the replaced quantization value to inverse linear quantization using the quantiza- 
tion step-size Q to calculate a mean value M', and adding a difference DM M* - M) between tiie mean value M* 
and the mean value M to all the ti'ansform coefficients In the block; 

calculating a mean value LM of the transform coefficients In tiie lowest frequency band after the additfon of the dif- 
35 ference DM; and 

reconstructing a digital image signal in which the digital information has been embedded using tiie lowest fre- 
quency band after the addition of tiie difference DM and the other frequency bands. 

[0081] As desaibed in the foregoing, according to the thirty-fourth aspect, the digital information is embedded in tiie 
40 transform coefficients in the lowest frequency band using either tiie discrete wavelet transform or the sub-band division. 
Consequentiy, It is possible to prevent the embedded digital Information from being lost against an attack for unautiior- 
ized utilization from a third person. 

[0082] A thirty-f ifdi aspect is directed to a digital information embedding method of embedding inherent digital Infor- 
matfon In a digital image signal, comprising tiie steps of: 

45 

dividing tiie digital Image signal into a plurality of blocks each composed of a plurality of pixels previously deter- 
mined, and subjecting, for each of tiie blocks, tiie block to ortiiogonal transform, to calculate ti-ansform coefficients; 
further classifying the plurality of blocks obtained by the division into groups each comprising one or two or tnore 
blocks In accordance witti a previously determined number of blocks; 
so extracting, for each of blocks belonging to each of the groups, the ti-ansform coefficient having the lowest frequency 
component (hereinafter refenred to as a DC component) out of tiie transform coefficients in tiie block and calculat- 
ing a mean value M of tiie respective DC components in tiie blocks, and subjecting the mean value M to linear 
quantization using a previously determined quantization step-size Q (Q is an integer of not less tiian one), to cal- 
culate a quantization value; 

55 replacing for each of the groups, on ttie basis of tiie quantization value and the value of the digital information to be 
embedded which correspond to tiie group, the quantization value; 

sul^ectlng for each of the groups ttie replaced quantization value to inverse linear quantization using tiie quantlza- 
tk>n step-size Q to calculate a mean value M'. and adding a difference DM (= M' - M) between tiie mean value M' 
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and the mean value M to alt the respective DC components in the blocks belonging to the group; 
subjecting the plurality of blocks after the addition of the difference DM to inverse orthogonal transform, to recon- 
struct a digital Image signal in which the digital information has been embedded; and 
calculating a mean value LM of the amplitude values of the pixels in the reconstructed digital image signal. 

5 

[0083] As described in the foregoing, according to the thirty-fifth aspect, the digital information is embedded only in 
the lowest frequency component using the orthogonal transform. Consequently, it is possible to prevent the embedded 
digital information from being lost against an attack for unauthorized utilization from a third person. 
[0084] A thirty-sixth aspect is characterized in that in the thirty-fifth aspect, 

10 

the step of respectively calculating the transform coefficients performs signal transformation which is any one of 
discrete cosine transform. Fourier transtbrm and Hadamard transform. 

[0085] As described in the foregoing, according to the thirty-sixth aspect, the typical system of the signal transforma- 
15 tion performed in the calculating step in the thirty-fifth aspect is specified. 

[0086] A thirty-seventh aspect is directed to a digital infomiation embedding method of embedding inherent digital 
Information in a digital image signal, comprising the steps of: 

dividing the digital image signal into a plurality of blocks each composed of a plurality of pixels previously deter- 
20 mined; 

calculating for each of the blocks a mean value M of the pixels conposing the block, and subjecting the mean value 
M to linear quantization using a previously determined quantization step-size Q (Q is an integer of not less tiian 
one), to calculate a quantization value; 

replacing for each of the blocks, on the t>asis of the quantization value and the value of the digital information to be 
2S embedded which con'espond to the block, the quantization value; 

subjecting for each of ttie blocks tiie replaced quantization value to inverse linear quantization using the quantiza- 
tion step-size Q to calculate a mean value M', and adding a difference DM (= M' - M) between the mean value M' 
and ttie mean value M to all the pixels composing the block; and 

calculating a mean value LM of tiie amplitude values of the pixels in tiie digital Image signal after tiie addition of the 
30 difference DM. 

[0087] As described in the foregoing, according to the thirty-seventh aspect, the digital information is embedded in 
the mean value of tiie pixels composing the block, tiiat is. the lowest frequency component. Consequentiy. it is possible 
to prevent the embedded digital Information from being lost against an attack for unautiiorized utilization from a third 
35 person. 

[0088] A tiilrty-elghth aspect is characterized In tiiat in the tiiirty-tourtii aspect. 

tiie step of replacing tiie quantization value replaces tiie quantization value witii an odd value closest to the value 
of (M/Q) when each of bits composing the digital information takes a logical value 1 . while replacing tiie quantiza- 
40 tion value with an even value closest to ttie value of (M/Q) when ttie bit takes a logical value 0. 

[0089] A ttiirty-nintti aspect is characterized in that in the ttiirty-f ifth aspect. 

the step of replacing ttie quantization value replaces tiie quantization value witii an odd value closest to the value 
46 of (M/Q) when each of bits composing the digital information takes a logical value 1 , while replacing tiie quantiza- 
tion value with an even value closest to tiie value of (M/Q) when tiie bit takes a logical value 0. 

[0090] A fbrtieth aspect Is characterized in tiiat in ttie ttiirty-slxtii aspect, 

so tiie step of replacing ttie quantization value replaces tiie quantization value wHh an odd value closest to the value 
of (M/Q) when each of bits composing ttie digital information takes a logical value 1 , while replacing ttie quantiza- 
tion value with an even value closest to the value of (M/Q) when ttie bit takes a logical value 0. 

[0091] A forty-first aspect is characterized in that in tiie thirty-se\/enth aspect. 

55 

the step of replacing ttie quantization value replaces the quantization value witii an odd value closest to the value 
of (M/Q) when each of bits composing the digital information takes a logical value 1 , while replacing tiie quantiza- 
tion value with an even value closest to the value of (M/Q) when tiie bit takes a logical value 0. 
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[0092] As described in the foregoing, according to the thirty-eighth to forty-first aspects, the quantization value is 
replaced with an odd or even value closest to the value of (M/Q) on the basis of the logical value of each of the bits com- 
posing the digital information in the thirty-fourth to thirty-seventh aspects. Consequently it is possible to reduce the 
effect on the degradation of the image at the time of extracting the embedded digital information, and it is difficult for a 
5 third person to detect the embedded digital information. 

[0093] A forty-second aspect is directed to a digital information extracting method of extracting inherent digital infor- 
mation enri)edded by a particular apparatus in transform coefficients in the lowest frequency band obtained by dividing 
a digital image signal using either discrete wavelet transform or sub-band division, wherein the digital image signal out- 
putted by the particular apparatus and a quantization step-size are inputted, comprising the steps of: 

10 

dividing the digital image signal into transform coefficients over a plurality of frequency bands using either discrete 
wavelet transform or sub-band division; 

dividing the lowest frequency band out of tiie plurality of frequency bands obtained by the division Into a plurality of 
blocks in accordance with a previously determined block size; 
15 calculating for each of the blocks a mean value M of the transform coefficients in the blocK and subjecting tiie mean 
value M to linear quantization using the previously determined quantization step-size Q. to calculate a quantization 
value; and 

judging whether the quantization value is even or odd, to extract ttie ennbedded digital infonnation on the basis of 
the results of the judgment. 

20 

[0094] As desaibed in the foregoing, according to the forty-second aspect, the logical value of the embedded digital 
information is judged by the results of extracting tiie transform coefficients which have been embedded in the lowest 
frequency band which is hardly affected by data destruction in high frequency bands, and calculating tiie quantization 
value of the mean value of tiie transfonn coefficients in each of tiie blocks in tiie lowest frequency band using a previ- 
25 ously determined method. Consequentiy. accurate digital information can be extracted witiiout being affected by an 
attack from an unautiiorized user. 

[0095] A forty-third aspect is directed to a digital information extracting method of extracting inherent digital informa- 
tion embedded by a particular apparatus in transform coefficients in the lowest frequency band obtained by dividing a 
digital image signal using eittier disaete wavelet transform or sub-band division, wherein the digital image signal out- 
30 putted by the particular apparatus, a quantization step-size, and a mean value LM of the transform coefficients in tiie 
lowest frequency band at ttie time of output are inputted, comprising tiie steps of: 

dividing the digital image signal into transform coefficients over a plurality of frequency bands using eitiier discrete 
wavelet transform or sub-band division: 

35 calculating a mean value LM' of the transform coefficients in the lowest frequency band out of the plurality of fre- 
quency bands obtained by tiie division, and subtracting a difference DM (s LM' - LM) between the mean value LM* 
and the mean value LM from all tiie transform coefficients in the lowest frequency band; 
dividing ttie lowest frequency band after tiie subtraction of the difference DL into a plurality of blocks in accordance 
witii a previously determined block size; 

40 calculating for each of the blocks a mean value M of the transform coefficients in the blocK and subjecting ttie mean 
value M to linear quantization using the quantization step-size Q, to calculate a quantization value; and 
judging whether the quantization value is even or odd, to extract ttie embedded digital information on tiie basis of 
ttie results of the judgment. 

45 [0096] As described in ttie foregoing, according to tiie forty-third aspect, tiie logical value of the embedded digital 
information is judged by the results of calculating, witii respect to the lowest frequency band including the transform 
coefficients whose mean value is con'ected using the mean values LM' and LM even when it is changed by image 
processing such as irreversible compression, tiie quantization value of the mean value of the transform coefficients in 
each of ttie blocks in the lowest frequency band using a previously determined metiiod. Consequentiy, more accurate 

so digital Information can be exta^acted witiiout being affected by an attack from an unauthorized user. 

[0097] A forty-fourth aspect is directed to a digital information extracting method of exti'acting inherent digital informa- 
tion embedded by a particular apparatus in transform coefficients obtained by subjecting a digital image signal to fre- 
quency transformation which is any one of discrete cosine transform, Fourier transform and Hadamard transform, then 
dividing ttie digital image signal into blocks, and subjecting each of the blocks to ortiiogonal transform, wherein tiie dig- 

55 ital image signal outputted by the particular apparatus and a quantization step-size are inputted, comprising the steps 
of: 

dividing tiie digital image signal into a plurality of blocks each composed of a plurality of pixels previously deter- 
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mined, and subjecting, for each of the blocks, the block to orthogonal transform, to calculate transform coefficients; 
further classifying the plurality of blocks obtained by the division into groups each comprising one or two or more 
blocks in accordance with a previously determined number of blocks; 

calculating for each of the groups a mean value of the respective transform coefficients having the lowest frequency 
6 oorrponents in the blocks belonging to the group, and Subjecting the mean value to linear quantization using the 
previously determined quantization step-size, to calculate a quantization value: and 

judging whether the quantization value is even or odd, to extract the embedded digital information on the basis of 
the results of the judgment. 

10 [0098] As described In the foregoing, according to the forty-fourth aspect, the logical value of the embedded digital 
information is judged by the results of extracting the transform coefficient which has been embedded in the lowest fre- 
quency conponent which is hardly affected by data destruction in high frequency bands, and calculating the quantiza- 
tion value of the mean value of the respective transform coefficients having the lowest frequency components in the 
plurality of blocks using a previously determined method. Consequently, accurate digital information can be extracted 

15 without being affected by an attack from an unauthorized user. 

[0099] A forty-fifth aspect is directed to a digital information ^racting method of extracting inherent digital inlbrmatbn 
embedded l>y a particular apparatus in transform coefficients obtained by subjecting a digital image signal to signal 
transformation which is any one of discrete cosine transform, Fourier transform and Hadamard transform, then dividing 
the digital image signal into blocks, and subjecting each of the blocks to orthogonal transform, wherein the digital image 

20 Signal outputted by the particular apparatus, a quantization step-size, and a mean value LM of the amplitude values of 
pixels in the digital image signal at the time of output are inputted, comprising the steps of: 

calculating a mean value LM' of the amplitude values of the pixels in the digital image signal at the time of input, 
and subtracting a difference DM (= LM' - LM) between the mean value LM' and the mean value from tiie values 
£5 of all the pixels in the digital image signal; 

dividing tiie digital image signal after the subtraction of the difference DL into a plurality of blocks each composed 
of tiie plurality of pixels previously determined, and subjecting, for each of the blocks, the block to ortiiogonal trans- 
form, to calculate transform coefficients: 

further classifying the plurality of blocks obtained by the divisiion into groups each comprising one or two or more 
30 blocks in accordance with a previously determined number of blocks; 

calculating for each of the groups a mean value of the respective b-ansform coefficients having the lowest frequency 
components in the blocks belonging to the group, and subjecting the mean value to linear quantization using tiie 
previously determined quantization step-size, to calculate a quantization value; and 

judging whettier tiie quantization value is even or odd, to extract tiie embedded digital infomiation on tiie basis of 
3s the results of the judgment. 

[01 00] As described in tiie foregoing, according to the forty-fifth aspect, tiie logical value of the embedded digital infbr- 
matbn is judged by tiie results of calculating, with respect to tiie lowest frequency component, in ttie digital image sig- 
nal, including the transform coefficients whose mean value is con-ected using the mean values LM' and LM of tiie 

40 anrplitude values of the pixels in the digital image signal even when it is changed by image processing such as irrevers- 
ible compression, the quantization value of tiie mean value of the respective transform coefficients having the lowest 
frequency components in the plurality of blocks using a previously determined method. Consequently, more accurate 
digital information can be extracted without being affected by an attack from an unautiiorized user. 
[0101] Afbrty-sixtii aspect is directed to a digital information extracting method of extracting inherent digital informa- 

45 tion embedded by a particular apparatus in a mean value of pixels composing each of blocks obtained by dividing a dig- 
ital image signal, wherein the digital image signal outputted by tiie particular apparatus and a quantization step-size are 
inputted, comprising tiie steps of: 

dividing the digital image signal into a plurality of blocks each corrposed of a plurality of pixels previously deter- 
so mined; 

calculating tor each of tiie blocks a mean value of the pixels composing tiie block, and sut>jecting the mean value 
to linear quantization using the quantization step-size, to calculate a quantization value; and 
judging whetiier the quantization value is even or odd, to extract the embedded digital infbrmation on the basis of 
the results of the judgment. 

55 

[0102] As described in ttie foregoing, according to the forty-si:(tii aspect, tiie logical value of tiie embedded digital 
infbrmation Is judged by ttie results of extracting tiie mean value of the pixels composing the block which is hardly 
affected by data destruction In high frequency bands, and calculating the quantization value of ttie mean value using a 
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previously determined method. Consequently, accurate digital information can be extracted without being affected by 
an attack from an unauthorized user. 

[0103] A forty-seventh aspect Is directed to a digital information extracting method of extracting inherent digital infor- 
mation embedded by a particular apparatus in a mean value of pixels composing each of blocks obtained by dividing a 
5 digital image signal, wherein the digital image signal outputted by the particular apparatus, a quantization step-size, and 
a mean value LM of the amplitude values of the pixels in the digital image signal at the time of output are inputted, com- 
prising the steps of : 

calculating a mean value LM' of the amplitude values of the pixels in the digital image signal at the time of input, 
10 and subtracting a difference DL (= LM' - LA^ between the mean value LM* and the mean value LM from the values 
of all the pixels in the digital image signal; 

dividing the digital image signal after the subtraction of the difference DL into a plurality of blocks each compibsed 
of a plurality of pixels previously determined; 

calculating a mean value of the pixels composing each of the blocks obtained by the division, and subjecting the 
IS mean value to linear quantization using the quantization step-size, to calculate a quantization value; and 

judging whether the quantization value is even or odd, to extract the embedded digital information on the basis of 
the results of the judgment. 

[01 04] As descrit>ed in the foregoing, according to the forty-seventh aspect, the logical value of the embedded digital 
20 information is judged by the results of calculating, with respect to the digital image signal including the blocks each com- 
posed of pixels whose mean value is corrected using the mean values LM' and LM of the amplitude values of the pixels 
in the digital image signal even when it is changed by image processing such as in-eversible compression, the quanti- 
zation value of the mean value of the pixels composing the block using a previously determined method. Ck>nsequentty, 
accurate digital information can be extracted without being affected by an attack from an unauthorized user. 
2S [0105] A forty-eighth aspect is directed to a digital information embedding method of embedding inherent digital infor- 
mation in a digital image signal, comprising the steps of : 

dividing the digital image signal into a plurality of frequency bands to obtain transform coefficients using either dis- 
crete wavelet transform or sub-band division; 

30 generating, with respect to each of the transform coefficients included in the one or two frequency bands out of the 
plurality of frequency bands obtained by the division, map information storing a true/false value based on decision 
whether or not all the absolute amplitude values of the transform coefficient and the other transform coefficients in 
the same space representation region in the same direction of division as the one or two frequency bands are not 
more than a previously determined set value; 

35 replacing all of the transform coefficient and the other transform coefficients which correspond to the position where 
the true/ialse value of the map information is true with a previously determined transform value on the basis of the 
value of the digital information to be embedded in he transform coefficients; and 

synthesizing the plurality of transfomi coefficients after the replacement, to reconstruct a digital image signal. 

40 [0106] As described in the foregoing, according to the forty-eighth aspect, the digital information is embedded in a 
frequency signal over a plurality of hierarchies using either the discrete wavelet transform or the sub-band division. Con- 
sequently, it Is possible to prevent the embedded digital information from being lost against an attack for unauthorized 
utilization from a third person. 

[0107] A forty-ninth aspect is characterized in that in the forty-eighth aspect. 

46 

the transform value is set to integers ± K which are not more than the set value, and 

the replacing step replaces the transform coefficient and the other transform coefficients with the transform value 
•I- K when each of bits composing the digital information takes a logical value 1 , while replacing the transform coef- 
ficients with the transform value - K when the bit takes a logical value 0. 

so 

[0108] As described in the foregoing, according to the forty-ninth aspect, the transform coefficient whose absolute 
amplitude value is not more than the set value Is replaced with the transform values ± K which are set to not more than 
the set value. Consequently, it is possible to reduce the effect on the degradation of the image at the time of extracting 
the embedded digital information, and it is difficult for a third person to detect the embedded digital information. 
56 [0109] A fiftieth aspect is characterized In that in the forty-eighth aspect. 

the generating step generates the map information with respect to the transform coefficients included in at least 
one or both of the frequency band which is low in its horizontal component and is high in its vertical component and 
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the frequency band which is high in Its horizontal component and is low in its vertical component. 
[0110] A fifty-first aspect is characterized in that in the forty-ninth aspect. 

5 the generating step generates the map information with respect to the transform coefficients included in at least 
one or both of the frequency band which is low in its horizontal component and is high in its vertical component and 
the frequency band which is high in its horizontal component and is low in its vertical component. 

[01 1 1 ] As described in the foregoing, according to the fiftieth and fifty-first aspects, the digital information Is embedded 
10 in the frequency signal having the lower frequency component in the forty-eighth and forty-ninth aspects. Consequently. 
It is possible to prevent the embedded digital Information from being lost against an attack for unauthorized utilization 
from a third person. 

[01 12] A f ifty-second aspect is directed to a digital information embedding method of embedding inherent digital Infor- 
mation In a digital image signal, comprising the steps of : 

15 

dividing the digital image signal into transform coefficients over a plurality of frequency bands using eitiier discrete 
wavelet transform or sub-band division; 

generating, with respect to each of the fransfbrm coefficients included in tiie one or two frequency bands out of the 
plurality of frequency bands obtained by the division, map information storing a frue/lalse value based on decision 
20 whetiier or not the absolute amplitude value of the transform coefficient is Included between upper-limit and lower- 
limit threshold values which are previously determined; 

replacing tiie transform coefficient conesponding to the position where the true/false value of the map information 
is frue witii a previously determined transform value on tiie basis of the sign of the fransform coefficient and tiie 
value of the digital information to be embedded in tiie transform coefficient; and 
25 synttiesizing the plurality of transform coefficients after tiie replacement, to reconsfruct a digital image signal. 

[01 13] As described in the foregoing, according to the fifty-second aspect, the digital information is embedded only in 
the transform coefficients in a deep hierarchical signal which is hardly affected using either tiie disaete wavelet tanns- 
form or tiie sub-band division. Consequentiy, it is possible to further prevent tiie embedded digital informatfon from 
30 being lost against an attack for unauthorized utilization from a third person. 

[0114] A fifty-third aspect Is directed to a digital informatfon embedding mettiod of embedding inherent digital infor- 
mation In a digital image signal, comprising the steps of : 

dividing the digital image signal into a plurality of block signals of a previously determined size, and subjecting, for 
35 each of the block signals, tiie block signal to orthogonal transform, to calculate transform coefficients; 

generating, witii respect to each of the transform coefficients included in the one or two block signals out of the plu- 
rality of block signals obtained by the division, map information storing a true/false value based on decision whether 
or not the absolute amplitude value of the transform coefficient is included between upper-limit and lower-limit 
threshold values which are previously determined; 
40 replacing the transform coefficient conesponding to the position where the true/false value of the map information 
is true with a previously determined transform value on the basis of the sign of the transform coefficient and tiie 
value of tiie digital information to be embedded in the transform coefficient; and 

8ut)jecting the plurality of transform coefffoients after tiie replacement to inverse orthogonal transform, to recon- 
sfruct a digital image signal. 

45 

[0115] As described in the foregoing, according to the fifty-third aspect, the digital information is embedded only in 
the transform coefficients in a deep hierarchical signal which is hardly affected using tiie ortiiogonal fransform. Conse- 
quentiy, it is possible to f urtiier prevent tiie embedded digital information from being lost against an attack for unautiior- 
ized utilization from a third person. 
so [0116] Afifty-fourtii aspect is characterized in that In tiie fifty-third aspect. 

the calculating step performs frequency transformation which is any one of discrete cosine transform. Fourier trans- 
form and Hadamard transform. 

55 [01 1 7] As described in tiie foregoing, according to the fifty-fourth aspect, the typical system of the frequency tiransfor- 
mation performed by tiie ortiiogonal transform means in ttie f ifty-tiiird aspect is specified. 
[01 18] A f ifty-f Iftti aspect is characterized in that in the fifty-second aspect. 
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the transform value is set to integers ± A and ± B between the upper-limit and lower-limit threshold values, and 
the replacing step replaces the transform coefficient with the transform value -i- A when each of bits composing the 
digrtal information takes a logical value 1 and the sign of the transform coefficient is positive, with the transform 
value - A when the bit takes a logical value 1 and the sign of the transform coefficient is negative, with the transform 
5 value + B when the bit takes a logical value 0 and the sign of the transform coefficient is positive, and with the trans- 
form value - B when the bit takes a logical value 0 and the sign of the transform coefficient is negative. 

[0119] A fifty-sixth aspect is characterized in that in the fifty-third aspect. 

10 the transform value is set to integers ± A and ± B between the upper-llmrt and fower-limit threshold values, and 

the replacing step replaces the transform coefficient with the transform value + A when each off bits composing the 
digrtal information takes a logical value 1 and the sign of the transform coefficient is positive, with the transform 
value - A when the bit takes a logical value 1 and the sign of the transform coefficient is negative, with the transform 
value + B when the bit takes a logical value 0 and the sign of the transform coefficient is positive, and with the trans- 

75 form value - B when the bit takes a logical value 0 and the sign of the transform coefficient is negative. 

[0120] A fifty-seventh aspect is characterized In that in the fifty-fourth aspect. 

the transform value is set to integers ± A and ± B between the upper-limit and lower-lim'tt threshold values, and 
20 the replacing step replaces the transform coeffk:ient with the transform value + A when each of bits composing the 
digital Information takes a logical value 1 and the sign of the transform coefficient is positive, with the transform 
value - A when the bit takes a logical value 1 and the sign of the transform coefficient is negative, with the transform 
value + B when the bit takes a logical value 0 and the sign of the transform coefficient is positive, and with the trans- 
form value - B when the bit takes a logical value 0 arKi the sign of the transform coefficient is negative. 

[0121] As described in the foregoing, according to the fifty-fifth to fifty-seventh aspects, the transform coefficient, 
whose absolute amplitude value is within the threshold range is transformed into and replaced with a value within the 
threshold range considering the sign of the transform coefficient. Ck}nsequently, it is possible to reduce the effect on the 
degradation of the image at the time of extracting the embedded digital information, and It is difficult for a third person 
30 to detect the embedded digital information. 

[0122] A fifty-eighth aspect is characterized In that in the fifty-second aspect, 

the generating step generates the map information with respect to the respective transform coefficients having the 
low frequency components other than the DC components. 

35 

[0123] A fifty-ninth aspect is characterized in that in the fifty-third aspect. 

the generating step generates the map information with respect to the respective transform coefficients having the 
fow frequency components other than the DC components. 

40 

[0124] A sixtieth aspect is characterized in that in the fifty-fourth aspect, 

the generating step generates the map information with respect to the respective transform coefficients having the 
fow frequency components other than the DC components. 

46 

[0125] A sixty-first aspect is characterized In that in the fifth-fifth aspect. 

the generating step generates the map information with respect to the respective transform coefficients having the 
fow frequency components other than the DC components. 

so 

[0126] A sixty-second aspect is characterized in that in the fifty-sixth aspect. 

the generating step generates the map information with respect to the respective transform coefficients having the 
low frequency components other than the DC components. 

ss 

[0127] A sixty-third aspect is characterized in that in the fifty-seventh aspect, 

the generating step generates the map Information with respect to the respective transform coefficients having the 
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low frequency components other than the DC components. 

[0128] As descnbed in the foregoing, according to the fifty-eighth to sixty-third aspects, the digital information is 
embedded in the frequency signal having the lower frequency component in the fifty-second to fifty-seventh aspects. 
5 Consequentiy. it is possible to further prevent the embedded digital information from being lost against an attack for 
unauthorized utilization from a third person. 

[0129] A sixty-fourth aspect is directed to a digital information extracting method of extracting inherent digital informa- 
tion embedded by a particular apparatus in transform coefficients obtained by dividing a digital image signal using either 
discrete wavelet transform or sub-band division, wherein the digital image signal outputted by the particular apparatus 
10 and map Information representing the position where the digital information is embedded are inputted, comprising the 
steps of : 

dividing the digital image signal into a plurality of frequency bands to obtain transform coefficients using either dis- 
crete wavelet transform or sub-band division; 

IS extracting, on the basis of the map information, the transform coefficient corresponding to the position where a 
true/false value of the map information is true and the other transform coefficients in the same space representation 
region in the same direction of division as the frequency band including the transfomi coefficient: 
calculating a total value of the transform coefficients Included in the one or two or nrtae frequency bands out of the 
transform coefficient and the other transform coefficients which are extracted: and 

20 judging the sign of the total value, to extract the embedded digital information on the basis of the results of the judg- 
ment, 

[0130] As described in the foregoing, according to the sixty-fourth aspect the logical value of the embedded digital 
information is judged by the results of extracting the transform coefficients which have been emt)edded in the low fre- 
25 quency band which is hardly affected by data destruction in high frequency bands, and calculating the total value of the 
transform coefficients using a previously determined method. Consequently, accurate digital information can be 
extracted without being affected by an attack from an unauthorized user. 

[0131 ] A sixty-fifth aspect is directed to a digital information extracting method of extracting inherent digital information 
embedded by a particular apparatus in transform coefficients obtained by dividing a digital image signal using either dis- 
30 aete wavelet transform or sub-band cfivision. wherein the digital image signal outputted by the particular apparatus, 
map information representing the position where the digital information is embedded, and information representing a 
transform value to be entbedded are inputted, comprising the steps of : 

dividing the image signal into a plurality of frequency bands to obtain transform coeffb'ents using either disaete 
35 wavelet transform or sub-band division ; 

extracting, on the basis of the map information, the transform coefficient corresponding to the position where a 
true^e value of the map information is true; 

calculating an absolute en-or between the extracted transform coefficient and the transform value: and 

Judging the absolute enror. to extract the embedded digital information on tiie basis of the results of the judgment. 

40 

[0132] As desaibed in the foregoing, according to tiie sixty-fifth aspect, the logical value of the embedded digital Infor- 
mation is judged by tiie results of extracting the transform coefficient which has been embedded in a deep hierarchical 
signal which is not affected by data destruction in high frequency bands, and calculating and judging the absolute en'or 
between the transfomi coefficient and the transform value using a previously determined method. Consequentiy. accu- 
45 rate digital information can be extracted without being affected by an attack from an unauthorized user. 

[0133] A sixty-sixth aspect is directed to a digital information extracting method of extracting inherent digital informa- 
tion embedded by a particular apparatus in transform coefficients obtained by subjecting a digital image signal to fre- 
quency fransformation which is any one of discrete cosine transform, Fourier transform and Hadamard transform, then 
dividing tiie digital image signal into blocks, and subjecting each of the blocks to orthogonal transform, wherein tiie dig- 
so ital innage signal outputted by the particular apparatus, map information representing the position where the digital infor- 
matfon is embedded, and infbmiation representing a transform value to be embedded are inputted, comprising tiie 
steps of : 

dividing the digital image signal into a plurality of block signals of a previously determined size, and subjecting, for 
55 each of the tAock signals, tiie block signal to orthogonal transform, to calculate transform coefficients; 

extracting, on tiie basis of the map information, the transform coefficient corresponding to the position where a 
true/lalse value of tiie map information is true; 

calculating an absolute error between the extracted transform coefficient and the transform value: and 
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judging the absolute error, to extract the embedded digital information on the basis of the results of the judgment. 

[0134] As described In the foregoing, acxxsrding to the sixty-sixth aspect, the logical value of the embedded digital 
infbnnation is judged by the results of extracting, even with respect to a particular digital image signal which has already 

5 been subjected to frequency transformation, the transform coefficient which has been embedded in a deep hierarchical 
signal which is not affected by data destruction in high frequency bands and calculating and judging the absolute error 
between the transform coefficient and the transform value using a previously determined method. Consequently, accu- 
rate digital information can be extracted without being affected by an attack from an unauthorized user 
[0135] A sixty-seventh aspect is directed to a recording medium having a program executed in a computer recorded 

10 thereon, the program realizing on the computer an operational environment comprising the steps of : 

dividing a digital image signal into transfbnti coefficients over a plurality of frequency bands using either discrete 
wavelet transform or sub-band division; 

dividing the lowest frequency band out of the plurality of frequency bands obtained by the division into a plurality of 

75 blocks in accordance with a previously determined block size; 

calculating for each of the blocks a mean value M of the transform coefficients in the blocK and subjecting the mean 
value M to linear quantization using a previously determined quantization step-size Q (Q is an integer of not less 
than one), to calculate a quantization value; replacing for each of the blocks, on the basis of the quantization value 
and the value of the digital information to be embedded which correspond to the block, the quantization value; sub- 

20 jecting for each of the blocks the replaced quantization value to inverse linear quantization using the quantization 
step-size Q to calculate a mean value M', and adding a difference DM (= M' - M) between the mean value M' and 
the mean value M to all the transform coefficients in the block; calculating a mean value LM of the transform coef- 
ficients in the towest frequency band after the addition of the difference DM; and reconstructing a digital image sig- 
nal In which the digital information has been embc^dded using the lowest frequency band after the addition of the 

2S difference DM and the other frequency bands. 

[0136] A sixty-eighth aspect is directed to a recording medium having a program executed in a computer recorded 
thereon, the program realizing on the computer an operational environment comprising the steps of : 

30 dividing a digital image signal into a plurality of blocks each composed of a plurality of pixels previously determined, 
and suk^ectlng. for each of the blocte, the block to orthogonal transform, to calculate transform coeff toients; 
further classifying the plurality of blocks obtained by the division into groups each comprising one or two or more 
blocks in accordance with a previously determined number of blocks; 

extracting, for each of the blocks belonging to each of the groups, the transform coefficient having the lowest fre- 
35 quency component (hereinafter referred to as a DC component) out of the transform coefficients in the block and 
calculating a mean value M of the respective DC components in the blocks, and subjecting the mean value M to 
linear quantization using a previously determined quantization step-size Q (Q is an integer of not less than one), to 
calculate a quantization value; 

replacing for each of the groups, on the basis of the quantization value and the value of the digital information to be 

40 embedded which correspond to the group, the quantization value; 

subjecting for each of the groups the replaced quantization value to inverse linear quantization using the quantiza- 
tion step-size Q to calculate a mean value M*. and adding a difference DM (= M' - M) between the mean value M' 
and the mean value M to all the DC components In the blocks belonging to the group; subjecting the plurality of 
blocks after the addition of the difference DM to inverse orthogonal transform, to reconstruct a digital image signal 

45 in which the digital information has been embedded; and 

calculating a mean value LM of the anplitude values of the pixels in the reconstructed digital Image signal. 

[0137] A sixty-ninth aspect is characterized in that in the sixty-eighth aspect. 

so the step of respectively calculating the transform coefficients performs signal transformation which Is any one of 
discrete cosine transform, Fourier transform and Hadamard transform. 

[0138] A seventieth aspect is directed to a recording medium having a program executed in a computer recorded ther- 
eon, the program realizing on the computer an operational environment comprising the steps of : 

55 

dividing a digital image signal into a plurality of blocks each composed of a plurality of pixels previously determined; 
calculating for each of the blocks a mean value M of the pixels composing the block, and subjecting the mean value 
M to linear quantization using a previously determined quantization step-size Q (Q is an Integer of not less than 
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one), to calculate a quantization value; 

replacing for each of the blocks, on the basis of the quantization value and the value of the digital information to be 
embedded which correspond to the block, the quantization value; 

subjecting for each of the blocks the replaced quantization value to inverse linear quantization using the quantiza- 
5 tlon step-size Q to calculate a mean value M', and adding a difference DM (= M' - M) between the mean value M* 
and the mean value M to all the pixels conposing the block; and 

calculating a mean value LM of the amplitude values of the pixels in the digital image signal after the addition of the 
difference DM. 

10 [0139] A seventy-first aspect is characterized in that in ti^e sixty-seventh aspect, 

the step of replacing the quantization value replaces the quantization value witii an odd '^lue closest to the value 
of (M/Q) when each of bits composing the digital information takes a logical value 1 , while replacing tiie quantiza- 
tion value with an even value closest to tiie value of (M/Q) when tiie bit takes a logical value 0. 

15 

[0140] A seventy-second aspect is characterized in that in the sixty-eighth aspect, 

the step of replacing tiie quantization value replaces the quantization value w'rth an odd value closest to the value 
of (M/Q) when each of bits composing the digital information takes a logical value 1 , while replacing tiie quantiza- 
20 tion value with an even value closest to tiie value of (M/Q) when tiie bit takes a logical value 0. 

[0141] A seventy-third aspect is characterized in that in the sixty-nintii aspect. 

the step of replacing tiie quantization value replaces tiie quantization value w'rth an odd value closest to the value 
25 of (M/Q) when each of bite composing the digital information takes a logical value 1 . while replacing tiie quantiza- 
tion value with an even value closest to tiie value of (M/Q) when tiie bit takes a logical value 0. 

[0142] A seventy-fourth aspect is characterized in that in the seventieth aspect, 

30 the step of replacing the quantization value replaces the quantization value witii an odd value closest to the value 
of (M/Q) when each of bits composing the digital information takes a logical value 1 , while replacing the quantiza- 
tion value with an even value closest to tiie value of (M/Q) when tiie bit takes a logical value 0. 

[0143] A seventy-fiftii aspect is directed to a recording medium having a program executed in a computer recorded 
35 thereon, tiie program realizing on the computer an operational environment comprising, with respect to a digital image 
signal having inherent digital information embedded by a particular apparatus in transform coefficients in the lowest fre- 
quency band obtained by dividing tiie digital image signal using either discrete wavelet transform or sub-band division, 
witii using a quantization step-size outputted by tiie particular apparatus, tiie steps of: 

40 dividing the digital image signal into transform coefficients over a plurality of frequency bands using either discrete 
wavelet transform or sub-band division; 

dividing tiie lowest frequency band out of tiie plurality of frequency bands obtained by tiie division into a plurality of 
blocks in accordance with a previously determined block size; 

calculating for each of the blocks a mean value M of tiie transform coefficients in the block, and subjecting tiie mean 
45 value M to linear quantization using the previously determined quantization step-size, to calculate a quantization 
value; and 

judging whettier tiie quantization value is even or odd, to extract tiie embedded digital information on tiie basis of 
the results of the judgment. 

so [0144] A seventy-sixth aspect is directed to a recording medium having a program executed in a computer recorded 
thereon, tiie program realizing on the computer an operational environment comprising, with respect to a digital image 
signal having Inherent digital information embedded by a particular apparatus in transform coefficients in the lowest fre- 
quency band otJtained by dividing the digital image signal using either discrete wavelet transfDrm or sub-band division, 
and with a quantization step-size outputted by the particular apparatus and a mean value LM of the transform coeffi- 

55 dents in the lowest frequency band at the time of output, tiie steps of : 

dividing the digital image signal into transform coefficients over a plurality of frequency bands using either discrete 
wavelet transform or sub-band division; 
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calculating a mean value LM' of the transform coefficients in the lowest frequency band out of the plurality of fre- 
quency bands obtained by the division, and subtracting a difference DM LM' - LM) between the mean value LM' 
and the mean value LM from all the transform coefficients in the lowest frequency band; 
dividing the lowest frequency band after the subtraction of the difference DL into a plurality of blocks in accordance 
5 with a previously determined block size; calculating Ibr each of the blocks a mean value M of the transform coeffi- 
cients in the blocK and subjecting the mean value M to linear quantization using the quantization step-size Q, to 
calculate a quantization value; and 

judging whether the quantization value is even or odd, to extract the embedded digital information on the basis of 
the results of the judgment. 

10 

[0145] A seventy-seventh aspect is directed to a recording medium having a program executed in a computer 
recorded thereon, the program realizing on the computer an operational environment comprising, with respect to a dig- 
ital image signal having inherent digital information embedded by a particular apparatus in transform coefficients 
obtained by subjecting the digital image signal to frequency transformation which is any one of discrete cosine trans- 
is form, Fourier transform and Hadamard transform, then dividing the digital image signal into blocks, and subjecting each 
of the blocks to orthogonal transform, and with using a quantization step-size outputted by the particular apparatus, the 
steps of : 

divkiing the digital image signal into a plurality of blocks each composed of a plurality of pixels previously deter- 
20 mined, and subjecting, for each of the blocks, the block to orthogonal transform, to calculate transform coefficients; 
further classifying the plurality of blocks obtained by the division into groups each comprising one or two or more 
blocks in accordance with a previously determined number of blocks: 

calculating for each of the groups a mean value of the respective transform coefficients having the lowest frequency 
components in the blocks belonging to the group, and subjecting the mean value to linear quantization using the 
25 previously determined quantization step-size, to calculate a quantization value; and 

judging whether the quantization value is even or odd, to extract the embedded digital information on the basis of 
the results of the judgment. 

[0146] A seventy-eighth aspect is directed to a recording medium having a program executed in a computer recorded 
30 thereon, the prog^ realizing on the computer an operational environment comprising, with respect to a digital image 
signal having Inherent digital information embedded by a particular apparatus in transform coefficients obtained by sub- 
jecting the digital image signal to signal transformation which is any one of discrete cosine transform, Fourier transform 
and Hadamard transform, then dividing the digital image signal into blocks, and subjecting each of the blocks to orthog- 
onal transform, with using a quantization step-size outputted by the particular apparatus and a mean value LM of the 
35 amplitude values of pixels in the digital image signal at the time of output, the steps of : 

calculating a mean value LM' of the amplitude values of the pixels in the digital image signal at the time of input, 
and subtracting a difference DM (» LM* - LM) between the mean value LM' and the mean value LM from the values 
of all the pixels in the digital image signal; 
40 dividing the digital image signal after the subtraction of the difference DL into a plurality of blocks each composed 
of a plurality of pixels previously determined, and subjecting, for each of the blocks, the block to orthogonal trans- 
form, to calculate transform coefficients; 

further classifying the plurality of blocks obtained by the division into groups each comprising one or two or more 
blocks in accordance with a previously determined number of blocks; 
45 calculating for each of the groups a mean value of the respective transform coefficients having the lowest frequency 
components in'the blocks belonging to the group, and subjecting the mean value to linear quantization using the 
previously determined quantization step-size, to calculate a quanti^iation value; and 

judging whether the quantization value is even or odd. to extract the embedded digital information on the basis of 
the results of the judgment. 

50 

[0147] A seventy-ninth aspect Is directed to a recording medium having a program executed in a computer recorded 
thereon, the program realizing on the computer an operational environment comprising, with respect to a digital image 
signal having inherent digital information embedded by a particular apparatus in a mean value of pixels composing each 
of blocks obtained by dividing the digital image signal, with using a quantization step-size outputted by the particular 
55 apparatus, the steps of: 

divkling the digital Image signal into a plurality of blocks each composed of a plurality of pixels previously deter- 
mined; 
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calculating for each of the blocks a mean value of the pixels composing the block, and subjecting the mean value 
to linear quantization using the quantization step-size, to calculate a quantization value; and 
judging whether the quantization value Is even or odd, to extract the embedded digital infbnnation on the basis of 
the resuHs of the judgment. 

5 

[0148] An eightieth aspect is directed to a recording medium having a program executed in a computer recorded ther- 
eon, the program realizing on the computer an operational environment comprising, with respect to a digital image sig- 
nal having inherent digital information embedded by a particular apparatus in a mean value of pixels composing each 
of blocks obtained by dividing the digital image signal, with using a quantization step-size and a mean value LM of the 
10 amplitude values of the pixels In the digital image signal at the time of output, the steps of 

calculating a mean value LM' of the amplitude values of the pixels in the digital image signal at the time of input, 
and subtracting a difference DL (= LM* - LM) between the mean value LM' and the mean value LM from the values 
of all the pixels in the digital image signal; 
15 dividing the digital image signal after the subtraction of the difference DL into a plurality of blocks each conrq30sed 
of a plurality of pixels previously determined; 

calculating a mean value of the pixels composing each of the blocks obtained by the division, and subjecting the 
mean value to linear quantization using the quantization step-size, to calculate a quantization value; and 
judging whether the quantization value is even or odd. to extract the embedded digital information on the basis of 
20 the resuHs of the judgment. 

[0149] An eighty-first aspect is directed to a recording medium having a program executed in a computer recorded 
thereon, the program realizing on the computer an operational environment comprising the steps of : 

25 dividing a digital Image signal into a plurality of frequency bands to obtain transform coefficients using either dis- 
crete wavelet transfbrm or sub-band division; 

generating, with respect to each of the transform coefficients included in the one or two frequency bands out of the 
plurality of frequency bands obtained by the division, map information storing a true/false value based on decision 
whether or not all the absolute amplitude values of the transform coefficient and the other transform coeffidents in 

30 the same space representation region in the same direction of division as the one or two frequency bands are not 
more than a previously determined set value; replacing all of the transfbrm coefficient and the other transfbrm coef- 
ficients which correspond to the position where the true/false value of the map information is true with a previously 
determined transform value on the basis of the value of the digital information to be embedded in the transform 
coefficients; and synthesizing the plurality of transform coefficients after the replacement, to reconstruct a digital 

35 image signal. 

[0150] An eighty-second aspect is characterized in that in the eighty-first aspect. 

the transform value is set to integers ± K which are not more than the set value, and 
40 the replacing step replaces the transform coefficient and the other transform coefficients with the transform value 
+ K when each of bits composing the digital information takes a logical value 1 , while replacing the transform coef- 
ficients with the transform value - K when the bit takes a logical value 0. 

[0151] An eighty-third aspect is characterized in that in the eighty-first aspect. 

45 

the generating step generates the map information with respect to the transform coefficients included in at least 
one or both of the frequency band which is low in its horizontal component and is high in its vertical component and 
the frequency band which is high in its horizontal component and is low in its vertical component. 

so [0152] An eighty-fourth aspect is characterized in that in the eighty-second aspect. 

the generating step generates the map Information with respect to the transform coefficients included in at least 
one or both of the frequency band which is low in its horizontal component and is high in its vertical component and 
the frequency band which is high in its horizontal component and is low in its vertical component. 

55 

[0153] An eighty-fifth aspect is directed to a recording medium having a program executed in a computer recorded 
thereon, the program realizing on the computer an operational environment comprising the steps of : 
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dividing a digital image signal into transform coefficients over a plurality of frequency bands using either discrete 
wavelet transform or sub-band division; 

generating, with respect to each of the transform coefficients included in the one or two frequency bands out of the 
plurality of frequency bands obtained by the division, map information storing a true/lalse value based on decision 
5 whether or not the absolute amplitude value of the transform coefficient is included between upper-limit and lower- 
limit threshold values which are previously determined; 

replacing the transform coefficient corresponding to the position where the true/false value of the map information 
is true with a previously determined transform value on the basis of the sign of the transform coefficient and the 
value of the digital information to be embedded in the transform coefficient; and 
10 synthesizing the plurality of transform coefficients after the replacement, to reconstruct a digital image signal. 

[0154] An eighty-sixth aspect is directed to a recordi:ig medium having a program executed in a computer recorded 
thereon, the program realizing on the computer an operational environment comprising the steps of : 

IS dividing a digital Image signal into a plurality of block signals of a previously determined size, and subjecting, for 
each of the block signals, the block signal to orthogonal transform, to calculate transform coefficients; 
generating, with respect to each of the transform coefficients included in the one or two block signals out of the plu- 
rality of block signals obtained by the division, map information storing a true/false value based on decision whether 
or not the absolute amplitude value of the transform coefficient is included between upper-limit and lower-limit 

20 threshold values which are previously determined; 

replacing the transform coefficient corresponding to the position where the true/false value of tiie map information 
is ti'ue with a previously determined transform value on the basis of the sign of the transform coefficient and the 
value of the digital information to be embedded in the transform coefficient; and 

subjecting the plurality of transform coefficients after the replacement to inverse orthogonal transform, to recon- 
25 struct a digital Image signal. 

[0155] An eighty-seventh aspect Is characterized in tiiat in the eighty-sixth aspect, 

the calculating step performs frequency transformation which is any one of discrete cosine transform. Fourier trans- 
30 form and Hadamard transfonn. 

[0156] An eighty-eightii aspect is characterized in that in the eighty-fiftii aspect. 

the transform value is set to integers ± A and ± B between the upper-ilmit and lower-limit threshold values, and 
35 the replacing step replaces the transform coefficient with tiie transform value + A when each of bits composing ttie 
digital information takes a logical value 1 and the sign of the transform coefficient is positive, witii the transform 
value - A when the bit takes a logical value 1 and the sign of the transform coefficient is negative, witii the transform 
value + B when the bit takes a logical value 0 and the sign of the transform coefficient is positive, and with the trans- 
form value - B when ttie bit takes a logical value 0 and the sign of ttie transform coefficient is negative. 

40 

[0157] An eighty-ninth aspect is characterized in tiiat in tiie eighty-sixth aspect, 

the transform value is set to integers ± A and ± B beNveen the upper-limit and lower-limit threshold values, and 
the replacing step replaces the transform coefficient witii ttie transform value + A when each of bits composing ttie 
45 digital information takes a logical value 1 and the sign of tiie transform coefficient is positive, witii the transform 
value - A when the bit takes a logical value 1 and the sign of the transform coefficient is negative, with the transform 
value + B when tiie bit takes a logical value 0 and the sign of the transform coefficient is positive, and witii the trans- 
form value - B when ttie bit takes a logical value 0 and the sign of ihe transform coefficient is negative. 

so [0158] A ninetieth aspect is characterized in that in tiie eighty-seventh aspect. 

the transform value is set to integers ± A and ± B between the upper-limit and lower-limit threshold values, and 
the replacing step replaces the transform coefficient with ttie ti^ansform value + A when each of bits composing ttie 
digital information takes a logical value 1 and the sign of the transform coefficient is positive, witii the transform 
55 value - A when ttie bit takes a logical value 1 and the sign of the transform coefficient is negative, with the transform 
value + B when tiie bit takes a logical value 0 and the sign of the transform coefficient is positive, and witii the trans- 
form value - B when ttie bit takes a logical value 0 and the sign of ttie transform coefficient is negative. 
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[0159] A ninety-first aspect is characterized in that in the eighty-fifth aspect. 

the generating step generates the map information with respect to the respective transform coefficients having the 
low frequency components other than the DC components. 

5 

[0160] A ninety-second aspect is characterized in that in the eighty-sixth aspect 

the generating step generates the map information with respect to the respective transform coefficients having the 
low frequency components other than the DC components. 

10 

[0161] A ninety-third aspect is characterized in that in the eighty-seventh aspect. 

the generating step generates the map information with respect to the respective transform coefficients having the 
low frequency components other than the DC components. 

15 

[0162] A ninety-fourth aspect is characterized in that in the eighty-eighth aspect. 

the generating step generates the map information with respect to the respective transform coefficients having the 
low frequency components other than the DC components. 

20 

[0163] A ninety-fifth aspect is characterized in that in the eighty-ninth aspect, 

the generating step generates the map information with respect to the respective transform coefficients having the 
low frequency components other than the DC components. 

25 

[0164] A ninety-sixth aspect is characterized in that in the ninetieth aspect. 

the generating step generates the map information with respect to ttie respective transform coefficients having the 
low frequency components other tiian the DC components. 

30 

[0169] A ninety-seventh aspect is directed to a recording medium having a program executed in a computer, the pro- 
gram realizing on tiie computer an operational environment comprising, with respect to a digital image signal having 
inherent digital information embedded by a particular apparatus in transform coefficients obtained by dividing tiie digital 
image signal using either discrete wavelet transform or sub-band division, with using map information outputted by the 
35 particular apparatus and representing the position where the digital information Is embedd^, the steps of : 

dividing the digital image signal into transform coefficients over a plurality of frequency bands using either discrete 
wavelet transform or sub-band division; 

ext^cting, on the basis of the map information, the transform coefficient corresponding to the position where a 
40 true/false value of tiie map information is true and the other transform coefficients in the same space representation 
region in the same direction of division as the frequency band including the transform coafficient; 
calculating a total value of the transform coefficients included in the one or two or more frequency bands out of tiie 
transform coefficient and the otiier transform coefficients which are extracted: and 

judging tiie sign of tiie total value, to extract tiie embedded digital information on tiie basis of tiie results of tiie judg- 
es ment 

[0166] A ninety-eigtitii aspect is directed to a recording medium having a program executed in a conputer recorded 
thereon, tiie program realizing on the computer an operational environment comprising, with respect to a digital image 
signal having inherent digital information embedded by a particular apparatus in transform coefficients obtained by 
so dividing tiie digital image signal using eitiier discrete wavelet transform or sub-band division, witii using map information 
outputted by tiie particular apparatus and representing the position where tiie digital information is embedded and infor- 
mation representing a transform value to be embedded, the steps of : 

dividing tiie image signal into transform coefficients over a plurality of frequency bands using either discrete wavelet 
55 transform or sub-band division; 

extracting, on tiie basis of the map information, the transform coefficient corresponding to the position where a 
trueAlalse value of tiie map information is true: 

calculating an absolute en^or between the extracted transform coefficient and the transform value; and 
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judging the absolute error, to extract the embedded digital information on the basis of the results of the judgment 

[0167] A ninety-ninth aspect Is directed to a recording medium having a program executed In a computer, the program 
realizing on the computer an operational environment comprising, with respect to a digital image signal having inherent 
5 digital information embedded by a particular apparatus in transform coefficients obtained by subjecting the digital image 
signal to frequency transformation which is any one of discrete cosine transform, Fourier transform and Hadamard 
transform, then dividing the digital image signal into blocks, and subjecting each of the blocks to orthogonal transform, 
with using map Information outputted by the particular apparatus and representing the position where the digital infor- 
mation is embedded and information representing a transform value to be embedded, the steps of : 

10 

dividing the digital image signal Into a plurality of block signals of a previously determined size, and subjecting, for 
each of the block signals, the block signal to orthogonal transform, to calculate transform coefficients: 
extracting, on the tasis of the map Information, the transform coefficient corresponding to the position where a 
true/false value of the map information is true; 
15 calculating an absolute error between the extracted transform coefficient and the transform value; and 

judging the absolute error, to extract the embedded digital information on tiie basis of the results of the judgment. 

[0168] As described in the foregoing, the sixty-seventh to ninety-ninth aspects are directed to the recording mediums 
respectively having programs for carrying out digital information embedding and exf acting methods in the foregoing 
20 forty-fifth to sixty-sixtii aspects. This corresponds to the supply of the digital information embedding and extracting 
methods in the forty-fifth to sixty-sixth aspects to the existing apparatus in the form of software. 
[0169] The foregoing and otiier objects, features, aspects and advantages of the present invention will become more 
apparent from the following detailed description of the present Invention when taken in conjunction with the accompa- 
nying drawings. 

25 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0170] 

30 Fig. 1 is a block diagram showing the construction of a digital information embedding apparatus 1 a according to a 
first embodiment of the present invention; 

Rg. 2 is a flow chart showing processing performed In a block division portion 1 2, a quantization portion 13. a signal 
replacement portion 14. and a mean difference addition portion 15 shown in Fig. 1 ; 
Fig. 3 Is a diagram showing an example of blocks obtained by dividing an LL3 signal; 
35 Fig. 4 is a diagram showing an example of processing performed in the signal replacement portion 14 shown In Fig. 
1; 

Figs. 5 (a) to 5 (c) are diagrams showing an exanrple of processing performed in the mean difference addition por- 
tion 15 shown In Fig. 1; 

Fig. 6 Is a block diagram showing an example of the structure of a band synthesis portion 17 shown in Fig. 1 ; 
40 Fig. 7 Is a block diagram showing an example of the structure of a first band synthesizing fitter shown In Fig. 5; 

Rg. 8 is a block diagram showing tiie construction of a digital information exb^acting apparatus lb according to a 
second embodiment of the present invention; 

Fig. 9 is a flow chart showing processing performed in a mean difference subtraction portion 21, a block division 
portion 12. a quantization portion 13. and a digital information judgment portion 22 shown in Fig. 8; 
45 Figs. 10 (a) to 10 (c) are diagrams showing an exatnple in which digital Information is extracted from tiie x-tii block; 
Rg. 1 1 1s a block diagram showing the construction of a digital information embedding apparatus 2a according to 
a third emtx)diment of the present invention; 

Figs. 1 2 (a) to 1 2 (c) are diagrams showing an example of processing performed in an orthogonal transform portion 
31 shown in Fig. 1 1 ; 

50 Fig. 13 Is a diagram showing an example of processing performed in a block selection portion 32 shown in Fig. 1 1 ; 

Fig. 14 Is a flow chart showing processing performed in tiie bfock selection portion 32. a quantization portion 33, a 

signal replacement portion 14, and a mean difference addition portion 35 shown In Rg. 1 1 ; 

Rg. 15 is a block diagram showing the construction of a digital information extracting apparatus 2b according to a 

fourth embodiment of the present invention; 
55 Fig. 16 Is aflow chart showing processing performed in the digital information extracting apparatus 2b shown in Rg. 

15; 

Fig. 17 is a block diagram showing the construction of a digital Information embedding apparatus 3a according to 
a f iftii embodiment of the present invention; 
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Rg. 1 8 is a block diagram showing the construction of a digital information extracting apparatus 3b according to a 
sixth embodiment of the present invention; 

Fig. 19 is a block diagram showing the construction of a digital information embedding apparatus 4a according to 
a seventh embodiment of the present invention; 
5 Fig. 20 is a flow chart showing processing performed in a map information generation portion 52 shown In Fig. 19; 
Rgs. 21 (a) to 21 (b) are diagrams for explaining tiie generation of map information in the map information gener- 
ation portion 52; 

Rg. 22 is a flow chart showing processing performed in a signal replacement portion 53 shown in Rg. 19; 
Rg. 23 is a block diagram showing the construction of a digital information extracting apparatus 4b according to an 
10 eighth enribodiment of the present im'ention; 

Fig. 24 is a flow chart showing processing performed in a map information analysis portion 54, a coefficient calcu- 
lation portion 55, and a digital information judgment portion 56 shown in Fig. 23; 

Rg. 25 is a block diagram showing the construction of a digital information embedding apparatus 5a according to 
a ninth embodiment of the present invention; 
IS Fig. 26 is a flow chart showing processing performed in a map information generation portion 61 shown in Fig. 25; 
Rg. 27 is a diagram showing the contents of ti'ansformation designated by a signal transform portion 62 shown in 
Rg. 25; 

Fig. 28 is a f tow chart showing processing performed in a signal replacement portion 63 shown in Rg. 25; 
Rg. 29 is a block diagram showing the construction of a digital information extracting apparatus 5b according to a 
20 tenth emtx)diment of the present invention; 

Fig. 30 is a flow chart showing processing performed in a map information analysis portion 64, an error calculation 
portion 65, and a digital information judgment portion 66 shown in Fig. 29; 

Fig. 31 is a block diagram showing the construction of a digital information embedding apparatus 6a according to 
an eleventh embodiment of the present invention; 
25 Fig. 32 Is a block diagram showing the consb'uction of a digital information extracting apparatus 6b according to a 
twelftti enrrbodlment of tiie present invention; 

Fig. 33 is a block diagram showing an example of the structure of a conventional band dividing device 1 1 ; 

Fig. 34 Is a block diagram showing an example of the structure of a first band dividing filter 100 shown in Fig. 33; 

and 

30 Rg. 35 is a diagram showing representation of signals which have been subjected to discrete wavelet transform by 
tiie band dividing device 1 1 shown in Fig. 33 by a two-dimensional frequency region. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

35 (First Embodiment) 

[0171] Fig. 1 is a block diagram showing the construction of a digital information embedding apparatus according to 
a first embodiment of the present invention. In Fig. 1 , the digital Information ombedding apparatus 1 a comprises a band 
division portion 1 1 . a block division portion 12, a quantization portion 1 3, a signal replacement portion 14. a mean dif- 
40 ference addition portion 15, a mean calculation portion 16, and a band synthesis portion 17. 

[0172] The band division portion 1 1 In the digital information embedding apparatus 1 a according to the first embodi- 
ment has the same structure as the band dividing device 1 1 described in the above-mentioned prior art, and is assigned 
the same reference numeral aixi hence, the description thereof is not repeated. 

[0173] The band division portion 1 1 receives a digitized image signal 71 , and divides the image signal 71 into 1 0 fre- 
45 quency bands, i.e.. an LL3 signal. LHI signals, HLi signals and HHi signals (i = 1 to 3. the same is true for tiie following) 
by discrete wavelet transform, to calculate respective transform coefficients. The block division portion 12 divides the 
lowest frequency band signal (the LL3 signal) obtained by the division in tiie band division portion 1 1 into a plurality of 
blocks in accordance witii a previously determined block size. The quantization portion 1 3 finds, for each of tiie plurality 
blocks obtained by the division in the block division portion 1 2, a mean value M of the transform coefficients in the block. 
so The quantization portion 13 subjects the found mean value M to linear quantization using a previously determined 
quantization step-size Q, to calculate a quantization value q. The signal replacement portion 14 replaces tiie quantiza- 
tion value q fbund in the quantization portion 1 3 with a value (q + 1 ) or a value (q - 1 } on the basis of tiie value of digital 
information to be embedded in the block. The mean difference addition portion 15 subjects the quantization values (q 
± 1) obtained t>y the replacement in the signal replacement portion 1 4 to inverse linear quantization using the quantiza- 
55 tion step-size Q, to respectively find mean values M'. The mean difference addition portion 1 5 calculates for each of the 
blocks a difference DM between the found mean value M' and the above-mentioned mean value M (DM = M' - M). and 
respectively adds the difference DM to all tiie transform coefficients in the block. The mean catculatfon portion 16 cal- 
culates a mean value LM of all the transform coefficients in the LL3 signal which has been subjected to the addition 
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processing In the mean difference addition portion 1 5. The band synthesis portion 1 7 synthesizes the LL3 signal which 
has been subjected to the embedding processing and a plurality of other frequency band signals, to reconstruct an 
image signal 72. 

[0174] Referring now to Figs. 2 to 7. a digital information embedding method earned out by the digital infornfiation 

5 embedding apparatus 1 a will be described while taking specif rc examples. 

[0175] Fig. 2 is a flow chart showing processing performed in the block division portion 1 2, the quantization portion 
13, the signal replacement portion 14, and the mean difference addition portion 15. Fig. 3 is a diagram showing an 
example of blocks obtained by dividing the LL3 signal. Fig. 3 illustrates, in a case where the LL3 signal Is divided into 
blocks of a 2 X 2 size, four transform coefficients in the x-th block. Fig. 4 is a diagram showing an example of processing 

10 perfbnned in the signal replacement portion 1 4. Fig. 5 Is a diagram showing an example of processing performed In the 
mean difference addition portion 15. Fig. 6 is a block diagram showing an exanrpie of the structure of the band synthesis 
portion 17. Rg. 7 Is a block diagram showing an example of the structure of a first band synthesizing filter. 
[0176] In the following description, digital information to be embedded in an image shall be a bit stream obtained by 
binary-coding the name of a copyright owner, the date for generation, and so forth. 

75 [0177] Referring to Fig, 2, the block division portion 1 2 first divides the LL3 signal outputted by the band division por- 
tion 1 1 into the first to N-th (N is an integer which Is not less than two; the same is true for the following) blocks In accord- 
ance with a previously determined block size (step S201). The number of blocks N obtained by the division may be not 
less than the number of logical values, of the digital infbnnation. to be embedded. 

[0178] The size of the block nnay be an arbitrary size other than the 2 x 2 size illustrated in Fig. 3. The shape of the 
20 block need not be a square such as a regular square or a rectangle, and may be another shape (for example, a triangle 
or a rhombus). 

[0179] The quantization portion 13 then calculates a mean value Mn of transform coefficients in the n-th (n s 1 to N; 
the same is true for the following) block (step S202). 

[0180] In the foregoing step S201 . when the size of the block obtained by the division is set to a 1 x 1 size, processing 
25 for calculating a mean value need not be performed. 

[0181] For example, in Fig. 3, a mean value Mx in the x-th block is as follows: 

• Mx = (23 + 29 + 27 + 45) /4 = 31 

30 [0182] Referring to Fig. 2 again, the quantization portion 1 3 further subjects the mean value Mn to linear quantization 
using the previously determined quantization step-size Q (Q is an integer of not less than one), to calculate a quantiza- 
tion value qn (step S203). The linear quantization means rounding a certain numerical value to a whole number by 
rounding up or down figures after its decimal point in accordance with a round-off rule (a function int(m) shall represent 
linear quantization of m). The quantization step-size Q is the spacing between a transform value in a case where digital 

35 information to be embedded takes a logical value "1 " and a transform value In a case where it takes a logical value "0". 
or the amount of replacement. When tiie quantization step-size Q is decreased, therefore, the quality of the image In 
which the digital information is to be embedded is hardly degraded, while tiie attack resistance of tiie digital information 
to be embedded is decreased. When tiie quantization step-size Q is increased, the attack resistance of the digital Infor- 
mation is Increased, while the quality of the iamge is significantly degraded because the amount of replacement is 

40 increased. Consequentiy. the quantization step-size Q is not uniquely determined but can be arbitrarily set by a target 
and object image signal. In the description of the first embodiment, the quantization step-size Q is taken as 10. 
[0183] For example, in Fig. 3. the quantization value qx in the x-th block is as follows because tiie mean value Mx Is 
31 as described above: 

4S qx = int (Mx/Q) « Int (31/10) = 3 

[0184] Referring to Rg. 2 again, the signal replacement portion 14 extracts the logical value ("1 " or "0"), of the digital 
information, to be embedded in tiie n-th block (step S204). Thereafter, the signal replacement portion 14 judges 
whether the quantization value qn is even or odd (step S205). When the quantization value qn is even In the judgment 

so at the step S205, the signal replacement portion 14 furtiier judges whether or not tiie logical value to be embedded 
which is extracted at tiie foregoing step S204 is "r (step S206). When tiie logical value to be embedded Is "1" In tiie 
judgment at the step S206, the signal replacement portion 14 takes an odd number closes;t to the value of Mn/Q (either 
qn -I- 1 or qn - 1) as a quantization value qn' (that is, the quantization value qn is replaced with qn') (step S208). Contrary 
to this, when the logical value to be embedded is "0" in the judgment at the step S206, the signal replacement portion 

55 14 takes the quantization value qn as a quantization value qn' (step S2 1 0). 

[0185] On the other hand, when the quantization value qn is not even (tiiat is, odd) in the judgment at tiie step S205, 
tiie signal replacement portion 14 further judges whetiier or not the logical value to be embedded is "0" (step S207). 
When the logical value to be embedded is "0" in the judgment at the step S207. the signal replacement portion 1 4 takes 
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an even number closest to the value of Mn/Q (either qn + 1 or qn - 1) as a quantization value qn' (step S209). Contrary 
to this, when the logical value to be embedded is T in the judgment at the step S207. the signal replacement portion 
14 takes the quantization value qn as a quantization value qn' (step S210). 

[0186] For example, referring to Fig. 4, the quantization value qx in the x-th block shown in Fig. 3 is "3" (an odd 
5 number) as described above, and Mx/Q » 3.1 . By following the steps S205 to S210. therefore, when the logical value 
T of the digital information is embedded in the x-th block, the quantization value qx is odd, so that the value of qx =: 3 
is taken as a quantization value qx=3. Contrary to this, when the logical value "0" of the digital information is embedded 
in the x-th block, an even number closest to the value of Mx/Q = 3.1, I.e., "4** is taken as a quantization value qx' 
(qx-^qx+l). 

10 [0187] Referring to Fig. 2 again, the mean difference addition portion 15 performs inverse linear quantization using 
the quantization value qn' which is found at any one of the foregoing steps S208 to S210 and the quantization step-size 
Q , to calculate a mean value Mn' qn'*Q) (step S21 1). The mean difference addition portion 15 finds a difference DMn 
between the calculated mean value Mn' and the mean value Mn found at the foregoing step S202 (DMn = Mn' - Mn ) 
(step S212). Further, the mean difference addition portion 15 adds the difference DMn to all the transform coefficients 

15 in the n-th block (step S21 3) . 

[0188] For example, refen-ing to Fig. 5, when the logical value "0" of the digital information is embedded in the x-th 
block, the quantization value qx* Is four, as described above, so that a mean ^^alue Mx* after the inverse linear quantlza- 
tton is as fbliows: 

20 Mx' = qx'*Q = 4*10«40 

A (fifference DMx from the mean value Mx is as follows: 

DMx B Mx* - Mx 40 - 31 » + 9 

25 

The difference DMx is added to each of the transform coefficients in the x-th block, to create a transform coefficient after 
digital information embedding processing (Fig. 5 (b)). 

[0189] On the other hand, when the logical value "1 " of the digital information is embedded in the x-th block, the quan- 
tization value qx' is tiiree, as described above, so that a mean value Mx' after tiie inverse linear quantization is as fol- 
30 lows: 

Mx' = qx'*Q = 3* 10 = 30 
A difference DMx from the mean value Mx is as fbliows: 

35 

DMxoMx'-Mx«30-31 »-1 

The difference DMx is added to each of the transform coefficients in tiie x-th block (in this case, is subtracted as a con- 
sequence), to create a transform coefficient after digital information embedding processing (Fig. 5 (c)). 

40 [0190] The quantization portion 13, the signal replacement portion 14, and the mean difference addition portion 15 
judge, in order to perform the above-mentioned digital information embedding processing (the foregoing steps S202 to 
S213) with respect to all the first to N-th blocks, whether or not ail the blocks have been processed (step S214). When 
there exists the bk)ck which has not been processed yet. thie program is returned to the foregoing step S202, to repeat- 
edly perform the same processing. 

45 [01 91 ] Thereafter, the mean calculation portion 1 6 calculates a mean value LM of all tiie transfbrm coefficients in tiie 
LL3 signal. The mean value LM will be a correction value for extracting, in extracting the embedded digital information 
as described later when the image signal is changed by an attack from the exterior, the digital information more reliably 
[0192] When the change of tiie image signal (particularly the LL3 signal) need not be considered because there is no 
attack from the exterior, it is possible to omit the structure of the mean calculation portion 16 for calculating the mean 

so value LM of the transform coefficients in the LL3 signal. 

[0193] When the number of bits composing the digital information is smaller than tiie number of blocks obtained by 
the division, methods such as a method of embedding all bits composing tiie digital information, and then continuously 
embedding the bHs. starting witii tiie first bit, and a method of embedding a bit "0 (or 1)" in ail tiie remaining blocks may 
be used. 

55 [0194] Description Is now made of processing performed by the band synthesis portion 1 7. in short, the band synthe- 
sis portion 17 performs processing reverse to the processing performed by the band division portion 1 1 . 
[019^ Referring to Fig. 6. the k)and synthesis portion 17 comprises first to third band synthesizing filters 400. 500 and 
600 having the same sti^ucture. Each of tiie first to third band synthesizing filters 400. 500 and 600 receives four fre- 
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quency band signals, and synthesizes the signals, to output one signal. 

[0196] The first band synthesizing filter 400 receives the LL3 signal in which the digital information has been embed- 
ded, and an LH3 signal, an HL3 signal and an HH3 signal, and synthesizes the signals, to generate an LL2 signal. The 
second band synthesizing filter 500 receives the LL2 signal obtained by the synthesis, and an LH2 signal, an HL2 signal 
5 and an HH2 signal, and synthesizes the signals, to generate an LL1 signal. The third band synthesizing filter 600 
receives the LL1 signal obtained by the synthesis, anci an LH1 signal, an HL1 signal and an HH1 signal, and synthe- 
sizes the signals, to generate an image signal 72. 

[0197] Rg. 7 is a block diagram showing an example of the structure off the first band synthesizing filter 400. In Rg. 
7. the first band synthesizing filter 400 comprises first to third two-band synthesis portions 401 to 403. The first to third 

70 two-band synthesis portions 401 to 403 respectively comprise LPFs 41 1 to 41 3. HPFs 421 to 423, up-samplers 431 to 
433 and 441 to 443 for inserting zero into a signal at a ratio of 2 : 1 . and adders 451 to 453. 
[0198] The first two-band synthesis portion 401 receives the LL3 signal and the LH3 signal, and transforms the sig- 
nals, respectively, into signals which are twice their original sizes using the up-samplers 431 and 441 , filters the two sig- 
nals obtained by the transformation with respect to their vertical components by the LPF 41 1 and the HPF 421 , and then 

IS adds the signals by the adder 451 , to output the result of the addition. On the other hand, the second two-band synthe- 
sis portion 402 receives the HL3 signal and the HH3 signal, and transforms the signals, respectively, into signals which 
are twice their original sizes using the up-samplers 432 and 442, filters the two signals obtained by the transformation 
with respect to their vertical components by the LPF 41 2 and HPF 422, and then adds the signals by the adder 452. to 
output the result of the addition. The third two-band synthesis portion 403 receives outputs of the adders 451 and 452. 

20 and transforms the outputs, respectively, into signals which are twice their original sizes using the up-samplers 433 and 
443. filters the two signals obtained by the transformation with respect to their horizontal conponents by the LPF 413 
and the HPF 423, and then adds the signals by the adder 453. to output the result of the addition. 
[0199] Consequently, the LL2 signal which is low in both its horizontal and vertical o^mponents, which is a second 
hierarchical signal, is outputted from the first band synthesizing filter 400. 

2S [0200] The second and third band synthesizing filters 500 and 600 also respectively perform the same processing as 
desaibed at)ove with respect to signals inputted thereto. 

[0201] The band synthesis portion 17 reconstructs the 10 frequency band signals, i.e.. the LL3 signal, the LHi signals, 
the HLi signals, and the HHi signals as the image signal 72 which has been subjected to the embedding processing, as 
described above, to output the image signal 72. together with the quantization step-size Q and the mean value LM. 
30 [0202] As desaibed in the foregoing, the digital infbrn^ation embedding apparatus la according to the first embodi- 
ment emt)eds the digital infbmrtation only In the transform coefficients in the lowest frequency band (the LL3 signal). 
Consequently, it Is possible to pr&yent the embedded digit&f Information from being lost against an attack for unauthor- 
ized utilization from a third person. 

[0203] Furthermore, the digital Information embedding apparatus la according to the first embodiment replaces the 
35 quantization value qn with either one of an odd value and an even value which are closest to the value of Mn/Q on the 
basis of the logical value of the digital information. Consequently, it is possible to reduce the effect on the degradation 
of the image at the time of extracting the embedded digital information, and It is difficult for the third person to detect the 
embedded digital infomiation. 

[0204] Discrete wavelet transform performed in the digital information embedding apparatus la according to the first 
40 embodiment is not limited to three hierarchies. It can be performed even many times until the LL signal reaches a 1 x 1 
element. 

[0205] Furthermore, the processing for replacing the quantization value qn in tiie signal replacement portion 14 may 
be replacement of tiie quantization value with an odd quantization value closest to tiie value of Mn/Q when the logical 
value, of the digital information, to be embedded is "0" and an even quantization value closest to the value of Mn/Q 
45 when the logk:al value is "1 

(Second Embodiment) 

[0206] Fig. 8 is a block diagram showing the construction of a digital information extracting apparatus according to a 
50 second embodiment of tiie present invention. The digital information extracting apparatus lb according to the second 
embodiment is an apparatus for extracting tiie digital information embedded by the digital information embedding appa- 
ratus la according to the first embodiment. In Fig. 8. the digital information extracting apparatus lb comprises a band 
division portion 1 1 . a mean difference subtraction portion 2 1 , a block division portbn 1 2. a quantization portion 1 3, and 
a digital information judgment portion 22. 
55 [0207] The band division portion 11, the block division portion 12 and the quantization portion 13 in the digital Infor- 
mation extracting apparatus lb according to the second embodiment respectively have the same structures as tiie 
band division portion 1 1 , the block division portion 12 and the quantization portion 13 in the digital Information embed- 
ding apparatus la according to the first embodiment, and are assigned tiie same reference numerals and hence, tiie 
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description thereof is not repeated. 

[0208] The band division portion 1 1 receives an image signal 81 . The innage signal 81 includes, in addition to the 
image signal 72 outputted by the band synthesis portion 17 in the digital information embedding apparatus la accord- 
ing to the first embodiment, the quantization step-size Q used for linear quantization in the quantization portion 13 in 

5 the digital Infbrmation embedding apparatus la, and tiie mean value LM of the transform coefficients in the LL3 signal 
which has been calculated in the mean calculation portion 16 in the digital information embedding apparatus la. The 
band division portion 1 1 subjects the inputted image signal 81 to discrete wavelet transform, to divide tiie image signal 
81 into ten frequency bands, i.e.. an LL3 signal, LHi signals, HLi signals and HHi signals, and calculate respective trans- 
form coefficients. The mean difference subti'action portion 21 calculates a mean value LM' of all ttie transform coeffi- 

10 cients In the LL3 signal, and finds a difference DL between the mean value LM' and the above-mentioned given mean 
value LM (DL B LA^* - LM ). The mean difference subtraction portion 21 subtracts the difference DL from all the trans- 
fbrm coefficients in the LL3 signal. The block division portion 1 2 divides the LL3 signal which has been subjected to tiie 
subtraction processing in the mean difference subtraction portion 21 into a plurality of blocks in accordance with a pre- 
viously determined block size. The quantization portion 1 3 finds, for each of the plurality of blocks obtained by the divi- 

15 sion in the block division portion 12, a mean value M of tiie transform coefficients in the block. The quantization portion 
13 subjects the found mean value M to linear quantization using the given quantization step-size Q, to calculate a quan- 
tization value q. The digital infbrmation judgment portion 22 judges whether each of the quantization values q calculated 
in the quantization portion 13 is even or odd, to judge tiie logical value of embedded digital information on the basis of 
the judgment. 

20 [0209] Referring now to Figs. 9 and 10, description is made of a digital infbrmation extracting method carried out by 
the digital infbrmation extracting apparatus lb. Fig. 9 is a flow chart showing processing performed in the mean differ- 
ence subtraction portion 21 , the block division portion 1 2. the quantization portion 1 3. and the digital infbrmation judg- 
ment portion 22. Fig. 10 is a diagram showing an example in which digital infbrmation is extracted from the x-tii block. 
Fig. 1 0 (a) illustrates transform coefficients in tiie x-lh block in the LL3 signal oulputted by the digital infbrmation embed- 

25 ding apparatus la (see Rg. 5 (b)). and Rg. 10 (b) illustrates transform coefficients in the x th block in the LL3 signal 
inputted to the digital infbrmation extracting apparatus lb. Fig. 10 (c) illustrates transform coefficients in the x-tii block 
which are obtained by correcting the transform coefficients shown in Fig. 10 (b) by the difference DL 
[0210] Refemng to Fig. 9, tiie mean difference subtraction portion 21 first calculates a mean value LM' of the trans- 
form coefficients in tiie LL3 signal (step S901). The mean difference subtraction portion 21 finds a difference DL 

30 between tiie calculated mean value LM' and the given mean value LM, to subtract the difference DL from all the fans- 
form coeffk;ients in the LL3 signal (step S902). 

[0211] For example, in Fig. 10, tiie mean value of tiie transform coefficients in the LL3 signal is changed from LM = 
50 to LM' B 53, so tiiat the difference DL is as follows: 

35 DL = LM' - LM - 53 - 50 = 3 

In order to subtract the difference DL = 3 from each of the transform coefficients, the transform coefficients in the x-tii 
block are changed from values shown in Fig. 10 (b) to values shown in Fig. 10 (c). 

[0212] Referring to Fig. 9 again, the block division portion 1 2 divides tiie LL3 signal which has been subjected to tiie 
40 subtraction processing in the mean difference subtraction portion 21 into the first to N-th blocks in accordance with a 
previously determined block size (step S903). The quantization portion 13 calculates for each of the blocks a mean 
value Mn of ttie transform coefficients in tiie block (step S904), and subjects tiie mean value Mn to linear quantization 
using the given quantization step-size Q, to find a quantijtation value qn (step S905). 
[0213] For example, in Fig. 10 (c), a mean value Mx in the x-th block is as follows: 

45 

Mx = (35 + 34 + 40 + 59)74 = 42 

Consequentiy, a quantization value qx in the x-tti block is as follows: 

so qx = int(Mx/Q)«int(42/10)s4 

[0214] Referring to Fig. 9 again, the digital Infbrmation judgment portion 22 judges whether the quantization value qn 
calculated at the foregoing step S905 is even or odd (step S906). When the quantization value qn is even in the judg- 
ment at the step S906, tiie digital information judgment portion 22 judges that the digital Information embedded in a 
55 position, corresponding to the n-th block, of tiie image signal takes a logical value "0" (step S907). On the other hand, 
when ttie quantization value qn is odd in the judgment at the step S90f>: the digital information judgment portion 22 
judges that the digital infbrmation embedded in ttie position, corresponding to the n-th block, of the image signal takes 
a logical value T (step S908). 
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[0215] For example, in Fig. 10 (c). the quantization value qx in the x-th block is "4" (an even number), as described 
above, so that it is judged that the logical value of the embedded digital information is "0". 

[0216] Thecfigital information judgment portion 22 judges, in order to perform the above-mentioned digital information 
extraction processing (the foregoing steps S904 to S908) with respect to ail the first to N-th blocks, whether or not all 
5 the blocks have been processed (step S909). When there exists the block which has not been processed yet, the pro- 
gram is returned to the foregoing step S904. to repeatedly perform the same processing. 

[0217] The digital information judgment portion 22 thus performs the above-mentioned digital information extraction 
processing with respect to all the first to N-th blocks, to respectively extract the logical values embedded In the Image 
signal, and reproduce the digital information as a bit stream. 
10 [0218] To nfiake sure, the difference DL is subtracted from each of the transform coefficients in the LL3 signal for the 
fdiowing reasons. 

[0219] Referring to Fig. 10. when the difference DL i3 not subtracted irrespective of the fiact that the image signal is 
changed (change from the mean value LM to the mean value LM*) by an attack from the exterior, a block where a mean 
value Mx is calculated includes the transform coefficients in the block shown in Fig. 10 (b). Consequently, the mean 
IS value Mx in this case is as follows: 

Mx = (38 + 37 + 43 -r 62) / 4 = 45 
A quantization value qx In the x-th block is odd as follows: 

20 

qx = int (Mx / Q) = Int (45 / 1 0) = 5 

That is. the logical value, of the digital information, embedded in the x-th block may, in some cases, be erroneously 
judged to be T. 

25 [0220] Therefore, the digital information extracting apparatus 1b according to the second embodiment perfbmns 
processing for subtracting the difference DL from each of the transform coefficients (conrection) in order to extract a cor- 
rect logical value more reliably. 

[0221] In the digital inlbrmation extracting apparatus lb according to the second embodiment can perform, in a case 
where the transform coefficients in the inputted LL3 signal hardly vary, the digital inlbrmation extraction processing wlth- 
30 out causing any problems even if the structure of the mean difference subtraction portion 21 (that is, the processing at 
the steps S901 and 902 in Fig. 9) is omitted. 

[0222] As described in the foregoing, the digital information extracting apparatus lb according to the second embod- 
iment of the present invention judges the logical value of the embedded digital Information by the results of extracting 
the transform coefficients which have been embedd^ in the lowest frequency band which is hardly affected by data 
35 destruction in high frequency bands, and calculating the quantization value of the mean value of tfie transform coeffi- 
cients in each of the blocks in the lowest frequency band using a previously determined method. Consequently, accu- 
rate digital information can be extracted without being affected by an attack from an unauthorized user. 

(Third Embodiment) 

40 

[0223] Rg. 1 1 is a block diagram showing the construction of a digital Information embedding apparatus according to 
a third embodiment of the present invention. In Fig. 11, the digital Information embedding apparatus 2a comprises an 
orthogonal transform portion 31, a block selection portion 32, a quantization portion 33, a signal replacement portion 
14, a mean difference addition portion 35. an inverse orthogonal transform portion 36, and a mean calculation portion 
45 37. 

[0224] The signal replacement portion 14 in the digital information embedding apparatus 2a according to the third 
en^odiment has the same structure as the signal replacement portion 14 in the digital information embedding appara- 
tus la according to the first embodiment, and is assigned the same reference numeral and hence, the description 
thereof is not repeated. 

so [0225] The orthogonal transform portion 31 receives a digitized image signal 71 , and divides the image signal 71 into 
a plurality of blocks in accordance with a previously determined block size. The orthogonal transform portion 31 sub- 
jects the signal to orthogonal transform for each of the plurality of blocks obtained by the division, to calculate transform 
coefficients in the block. The block selection portion 32 classifies the plurality of blocks obtained by the division in the 
orthogonal transform portion 31 into groups each comprising one or two or more blocks in accordance with a previously 

55 determined number of blocks. The quantization portion 33 finds, for each of the blocks belonging to each of the groups 
obtained by tiie classification in the block selection portion 32, the transform coefficient having the lowest frequency 
component (hereinafter referred to as a DC component) in the block and finds a mean value M of the DC components 
in the bk)cks. The quantization portion 33 subjects the found mean value M to linear quantization using a previously 
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determined quantization step-size Q, to calculate a quantization value q. The signal replacement portion 14 respec- 
tively replaces the quantization values q found in the quantization portion 13 with a value (q + 1) or a value (q - 1) on 
the basis of the values, of digital information, to be embedded in the blod^s. The mean difference addition portion 35 
subjects the quantization values (q ± 1 ) oistained by the replacement in the signal replacement poition 1 4 to inverse lin- 

5 ear quantization using tiie quantization step-size Q, to respectively find mean values M\ The mean difference addition 
portion 35 calculates for each of tiie groups a difference DM betvireen the found mean value M' and tiie above-men- 
tioned mean value M (DM = M' - M ). and respectively adds tiie difference DM to all the DC conrponents in the blocks 
in the group. The inverse orthogonal transform portion 36 subjects the respective blocks including the DC components 
which have been subjected to the addition processing in the mean difference addition portion 35 to inverse orthogonal 

10 transform, to construct an image signal 73. The mean calculation portion 37 calculates a mean value LM of the values 
of all pixels composing the image signal 73 reconstructed in the inverse orthogonal transform portion 36, to output tiie 
mean value LM, togetiier witti tiie image signal 73. 

[0226] Refering now to Figs. 12 to 14, description is made of a digital information embedding method carried out by 
the digital information embedding apparatus 2a. Fig. 12 is a diagram showing an example of processing performed in 

IS the orthogonal transform portion 31. Fig. 13 is a diagram showing an example of processing performed in the block 
selection portion 32. Fig. 14 is a flow chart showing proces.sing performed in tiie block selection portion 32, the quanti- 
zation portfon 33, tiie signal replacement portion 14, and tiie mean difference addition portion 35. 
[0227] Refemng to Fig. 12, the orthogonal transform portion 31 receives the digitized image signal 71. and divides 
the image signal 71 into the first to N-th blocks in accordance with a presnously determined block size (see Fig. 1 (a)). 

20 TTie orthogonal transform portion 31 subjects the signal in each of the first to N-th blocks obtained by the division to 
orthogonal transform, to calculate transform coefficients of the same block size. 

[0228] Fig. 12 illustrates a case where the image signal 71 is divided into a plurality of blocks each composed of pixels 
of a 8 X 8 size, and each of the blocks is subjected to orthogonal transform by discrete cosine transform (DCT) (see 
Figs. 12 (b) and 12 (c)). Out of tiie transform coefficients obtained by the orthogonal transform shown in Fig. 12 (c), the 
2S transform coefficient at the upper left (a portion painted in block in Fig. 1 2 (c)) is a DC component, which represents a 
mean value of the values of all the pixels composing the block shown In Fig. 12 (b). 

[0229] Refonring to Fig. 14. the block selection portion 32 classifies tho first to N-th blocks obtained by the division in 
the orthogonal transform portion 31 into the first to S-th (S is an integer satisfying 2 ^ S ^ N; the same is frue for the 
following) groups each comprising one or tv/o or more blocks in accordance with a previou&ly determined number of 
so blocks (step SI 401). The number of groups S obtained by the classification may be not less than the number of logical 
values, of the digital information, to be er\ibedded. 

[0230] For example, in Fig. 13. the classification is made by taking the four blodis, i.e., the first block, the second 
block, the eleventii block and the twelfth block as one group. 

[0231] The block size of the group obtained by the classification may be an arbitrary size otiier than the 2 x 2 size 

3s illusti^ated in Fig. 13. The shape of the group need not be a square such as a regular square or a rectangle, and may 
be anotiier shape (for example, a triangle or a rhombus). Further, the blocks in tiie group need not necessarily be adja- 
cent to each otiier, and the blocks which are not adjacent to each other may be selected and grouped. 
[0232] Referring to Fig. 1 4 again, the quantization portion 33 then extracts only tiie respective DC components in tiie 
plurality of blocks in the S-th (s = 1 to S; tiie same is true for the following) group, and calculates their mean value Ms 

40 (step SI 402). At the foregoing step S1401 , when the block size of the group obtained by the classification is taken as 
a 1 X 1 size, processing for calculating a mean value need not be performed. Further, the quantization portion 33 sub- 
jects ttie mean value Ms to linear quantization using a previously deterrnined quantization step-size Q (Q is an integer 
of not less than one), to calculate a quantization value qsO;tep S1403). The signal replacement portion 14 extracts tiie 
logical value, of digital Information, to be embedded in the s-tii group, and finds a quantization value qs*. as described 

45 in tiie first embodiment (steps S1404 to S1410). The mean difference addition portion 35 performs inverse linear quan- 
tization using tiie quantization value qs* foumj in any one of the foregoing steps S1408 to S1410 and the quantization 
step-size Q, to calculate a mean value Ms' (= qs'*Q) (step SI 411 ). The mean difference addition portion 35 finds a dif- 
ference DMs between ttie calculated mean value Ms' and the mean value Ms found at the foregoing step S1402 
(DMs = M8'-Ms) (step S1412). Further, the mean difference addition portion 35 adds the di^^rence DMs to the 

so respective DC components in all the blocks in tiie s-th group (step S1413). 

[0233] The block selection portion 32. the quantization portion 33. the signal replacement portion 14, and the mean 
difference addition portion 35 judge, in order to subject all the blocks in the first to S-tii groups to the above-mentioned 
digital information embedding processing (tiie foregoing steps S1402 to S1413). whether or not all the groups have 
been processed (step Si 41 4). When there exists the group which has not been processed yet, the program is returned 

ss to the foregoing step SI 402, to repeatedly perform the sam?? processing. 

[0234] When the digital Information embedding processing is terminated, the inverse orthogonal transfornri portion 36 
sulsjects tiie plurality of blocks including tiie respective DC components which have been subjected to the addition 
processing in tiie mean difference addition portion 35 to inverse orthogonal transform, to reconstruct an image signal 
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73. 

[0235] Thereafter, the mean calculation portion 37 calculates a mean value LM of the values of ail the pixels compos- 
ing the Image signal 73 reconstructed in the inverse orthogonal transform portion 36, to output the mean value LM, 
together with the reconstructed image signal 73 and the above-mentioned quantization step-size Q. The mean value 

5 LM has the same function as that desaibed in the first embodiment. 

[0236] As described in the foregoing, the digital information embedding apparatus 2a according to the third embodi- 
ment embeds the digital information into the respective transform coefficients having the lowest frequency components 
(DC components). Consequently, rt is possible to prevent the embedded digital information from being lost against an 
attack for unauthorized utilization from a third person. 

10 [0237] The digital information emt)edding apparatus 2a according to the third embodiment replaces the quantization 
value qs with either one of an odd value and an even value which are closest to the value of Ms/Q on the basis of the 
logical value of the digital information. Consequently, it is possible to reduce the effect on the degradation of the image 
at the time of extracting the embedded digital information, and it is difficult for the third person to detect the embedded 
digital information. 

IS [0238] The orthogonal transform performed in the orthogonal transform portion 31 in the digital information embed- 
ding apparatus 2a according to the third embodiment is not limited to the above-mentioned discrete cosine transform. 
For example, it may be Furrier transform or Hadamard transform. 

[0239] In the digital information ent)edding apparatus 2a according to the third embodimait. the mean calculation 
portion 37 is constructed in a stage succeeding the inverse orthogonal transform portion 36. to calculate the mean 
20 value LM of the values of all the pixels composing the imcige signal 73. However, the DC component out of the transform 
coefficients obtained by the orthogonal transform repnjsentG the maan value of the values of all the pixels composing 
the iamge signal, as described above (see Fig. 12). Consequently, the mean calculation portion 37 may be constructed 
between the mean difference addition portion 35 and the inverse orthogonal transform portion 36, to calculate a mean 
value of the respective DC components in the blod®. 

25 

(Fourth Embodiment) 

[0240] Fig. 15 is a block diagram showing the constn;ction of a digital information extracting apparatus according to 
a fourth embodiment of the present invention. The digital information extracting apparatus 2b according to the fourth 
30 embodiment is an apparatus for extracting the digital information embedded by the digital information embedding appa- 
ratus 2a according to the third embodiment. In Fig. 15. the digital information e)ctracting apparatus 2b comprises a mean 
difference subtraction portion 41 , an orthogonal transform portion 31 , a block selection portion 32, a quantization por- 
tion 33, and a digital information judgment portion 22. 

[0241] The orthogonal transform portion 31 , the block selection portion 32 and the quantization portion 33 in the dig- 

3S ital information extracting apparatus 2b according to the fourth embcdiment have the same structures as the orthogonal 
transform portion 31 , the block selection portion 32 and the quantization portion 33 in the digital information embedding 
apparatus 2a according to the third embodiment, and are assigned the same reference numerals and hence, the 
desaiption thereof is not repeated. The digital information judgment portion 22 has the same structure as the digital 
information judgment portion 22 in the digital information extracting apparatus 1 b according to the second enlbodinfient, 

40 and is also assigned the same reference numeral and hence, the description thereof is not repeated. 

[0242] The mean difference subtraction portion 41 receives an imag^ signal 82. The image signal 82 includes, in addi- 
tion to the image signal 73 outputted by the inverse orthogonal transfi:.rm portion 36 in the digital Information embedding 
apparatus 2a according to the third embodiment, the quantization step-size Q used for linear quantization in the quan- 
tization portion 33 in the digital information embedding apparatus 2a, and the mean value LM of the values of all the 

45 pixels composing the iamge signal 73 which has been calculated in the mean calculation portion 37 in the digital infbr- 
mation embedding apparatus 2a. The mean difference subtriiction portion 41 calculates a mean value LM' of the values 
of all pixels composing the inputt^-^i imagf3 signal 82, to find a cilfference DL between the mean value LM* and the given 
mean value LM (DL = IJVI' - LM ). The mean difference subtraction portion 41 subtracts the difference DL from the val- 
ues of all the pixels composing the iamge signal 82. The orthogonal transform portion 31 divides the image signal 82 

so which has been sukjected to the subtraction processing in the mean difference subtraction portion 41 into a plurality of 
blocks in accordance with a previorjsly determined block size, and then subjects the signal in each of the blocks, to cal- 
culate transform coefficients In the block. The block selection portion 32 classifies the plurality of blocks obtained by the 
division in the orthogonal transform portion 31 into groups each comprising one or two or more blocks in accordance 
with a previously determined number of blocks. The quanti2:ation portion 33 finds, for each cv the groups obtained by 

55 the classification in the block selection porton 32. a mean ^/aliie M of respective DC components in the blocks in the 
group. The quantization portion 33 subjects the found mean value M to linear quantization using the previously deter- 
mined quantization step-size Q, to calculate a quantization value q. The digital information judgment portion 22 judges 
whether each of the quantization values q calculated in the quantization portion 33 is even or odd, to judge the logical 
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value of the embedded digital information on the basis of the judgment. 

[0243] Referring now to Fig. 1 6. description is made of a digital information extracting method carried out by the digital 
Infonmation extracting apparatus 2b. Fig. 16 is a flow chart showing processing performed by the digital infbrnnation 
extracting apparatus 2b. 

5 [0244] The mean difference subtraction portion 41 calculates a mean value LM' of the values of all the pixels com- 
posing the image signal 82 (step Si 601). The mean difference subtract'on portion 41 finds a difference DL between the 
calculated mean value LM' and the given mean value LM, and subtracts the difference DL from the values of all the pix- 
els composing the image signal 82 (step SI 602). The orthogonal transform portion 31 divides the image signal 82 
which has been subjected to the subtraction processing in the mean difference subtraction portion 41 into the first to N- 

10 th blocks in accordance with a previously determined block size, and then subjects the signal In each of the blocks to 
orthogonal transform, to calculate transform coefficients in the block (step SI 603). The block selection portion 32 clas- 
sifies the first to N-th blocks obtained by the division in the ortficgcnal transform portion 31 into the first to S-th groups 
each comprising one or two or more bloc^'^ in accordance with a previously determined number of blocks (step S1604). 
The quantization portion 33 calculates for each of the groups a mean value Mn of the respective DC components in the 

75 blocks included in the group (step S1605), and subjects the mean value Mn to linear quantization using the given quan- 
tization step-size Q. to find a quantization value qn (step SI 606). The digital information judgment portion 22 performs 
the judgment processing described In the above-mentioned second embodiment, to judge all logical values, of the dig- 
ital information, embedded in positions, corresponding to the groups, of the image signal (steps S1607 to SI 609), The 
digital information judgment portion 22 judges whether or not all the groups liave been proce^^sed (step S1610). When 

20 there exists tiie group which has not been processed yet, tiie program is returned to the foregoing step SI 604, to 
repeatedly perform the same processing. 

[(^45] The digital information judgment portion 22 thus performs the above-mentioned digital information extraction 
processing with respect to all the first to S-th groups, to respectively extract the logical values embedded in tiie image 
signal, and reproduce the digital information as a bH stream. 

25 [0246] As described in the foregoing, the digital iriformalion e)rtracting apparatus 2b according to the fourth embodi- 
ment judges tiie logical values of the embedded digital information by the results of exacting the DC component which 
has been embedded in tine lowest frequency band which is hardly affected by data destruction in high frequency bands, 
and calculating tiie quantization value of tiie mean value of tiie DC components in the plurality of blocks using a previ- 
ously determined method. Consequentiy, accurate digital intormation can be extracted virithout being affected by an 

30 attack from an unauthorized user. 

[0247] The digital information exti'a<::ting apparatus 2b according to tii9 burtii embaliment can al?>c perform, in a case 
where the values of the pixels composing the inputted imago liignal 82 hardly vary, the digital information extracting 
processing without causing any problems even if the structure of the mean difference subtraction portion 41 (that is, ttie 
processing at the steps S1601 and S1602) is omitted, similarly to tiie akX3ve-mentioned digital information extracting 

55 apparatus 1b according to the second embodiment. 

[024q In contrast with the digital information embedding apparatus in which the mean calculation portion 37 is con- 
structed between the mean difference addition portion 35 and the invei'se ortiiogonal ti^ansform portion 36. as described 
in tiie above-mentioned third embodiment, tiie digital information extracting apparatus 2b according the fourth embod- 
iment is so consti'ucted that the mean difference subtraction portion 41 end the orthogonal transform portion 31 are 

40 replaced witii each other. 

(Fiftii Enfibodiment) 

[0249] Fig. 1 7 is a block diagram showing tiie construction of a digital information embedding apparatr js 3a according 
45 to a fifth embodiment of tiie present invention. In Fig. 1 7. tiie digital information embedding apparatus 3a comprises a 
block selection portion 32, a quantization portion 33. a signal raplEcement portion 14. a mean difference addition por- 
tion 35, and a mean calculation portion 37. 

[0250] As shown in Fig. 1 7, the digital Information embedding apparatus 3a according the fifth embodiment is so con- 
structed tiiat the orthogonal transform portion 31 and tiie in>/erse orthogonal transform portion 36 in tiie above-men- 
50 tioned digital information embedding apparatus 2a according to the third embodiment are omitted. 

[0251] The digital information embedding apparatus 3a according to the fifth embodiment can perform the same 
embedding processing as tiiat in the third embodiment even v^fle^ an image signal 71 is not subjected to orthogonal 
transform processing. 

[0252] Processing performed by tiie digital information embedding apparatus 3a will be briefly described. 
55 [0253] The block selection portion 32 receives a digitized Image signal 71 , and divides the image signal 71 into a plu- 
rality of blocks in accordance with a previously determined.block size, and then further classifies the blocks obtained by 
the division into groups each comprising one or two or more blocks In aaordance with a previously determined number 
of blocks. The quantization portion 33 calculates, for each cf the groups obtained by the classification in the block selec- 
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tion portion 32. a mean value M of the values of pixels composing each of the blocks in the group. The quantization por- 
tion 33 subjects the found mean value M to linear quantization using a previously determined quantization step-size Q, 
to calculate a quantization value qs. The signal replacement portion 14 replaces the quantization value q found in the 
quantization portion 13 with a value (q 4 1) or a value (q - 1) on the basis of the values, of the digital information, to be 

5 embedded in the blocks. The mean difference addition portion 35 subjects the quantization values (q ± 1) obtained by 
the replacement in the signal replacement portion 14 to inverse linear quantization using the quantization step-size Q, 
to respectively find mean values Ms*. The mean difference addition portion 35 calculates for each of the groups a dif- 
ference DMs between the found mean value Ms' and the above-mentioned mean value Ms (DM = M' - M ), and adds 
the difference DM to the values of all the pixels composing the blocks in the group, to output an image signal 74 which 

10 has been subjected to the embedding processing. The mean calculation portion 37 calculates a mean value LM of the 
values of all the pixels composing the iamge signal 74. 

[0254] As described in the foregoing, the digital information embedding apparatus 3a according to the fifth embodi- 
ment can also perform the digital information embedding processing described in the ab^ve-mentioned third embodi- 
ment with respect to the blocks where the inputted im£.ge signal is not subjected to discrete cosine transform. Fourier 
75 transform or Hadamard transform. 

(Sixth Embodiment) 

[0255] Fig. 18 is a block diagram showing the construction of a digital information extracting apparatus 3b according 
20 to a sixth embodim^t of the present invention. In Fig. 18. the digital information extracting apparatus 3b comprises a 
mean difference subtraction portion 41, a block selection portion 32. a quantization portion 33, and a digital information 
judgment portion 22. 

[0256] As shown in Fig. 18, the digital information extracting apparatus 3b according to the sixth embodiment is so 
constructed that the orthogonal transform portion 31 in the above-mentioned digital Information extracting apparatus 2b 
25 according to the fourth embodiment is omitted. 

[0257] The digital information extracting apparatus 3b according to the sixth embodiment is an apparatus for extract- 
ing the digital Infbrmation embedded by the digital information embedding apparatus 3a according to the fifth embodi- 
ment. 

[0258] Processing performed by tho digital information extracting a(3paratus 3b will be briefly described. 

30 [0259] The mean difference subtraction portion 41 receives an image signal 83. The image signal 83 includes, in addi- 
tton to the Image signal 74 outputled by the mean difference addition portion 35 In the digital infbrmation emt>edding 
apparatus 3a according to the fifth embodiment, the quantization step-size Q used for linear quantization in the quanti- 
zation portion 33 in the digital information embedding apparatus 3a. and the mean value LM o? the values of all the pix- 
els composing the image signal 74 which is calculated in the mean calculation portion 37 in the digits! information 

35 embedding apparatus 3a. The mean difference subtraction portion 41 calculates a mean value LM' of the values of ail 
pixels conrposing the inputted image signal 83, tof ind a difference DL between the mean value LM' and the given mean 
value LM (DL = LM' - LM ). The mean difference subtraction portion 41 subtracts the difference DL from the values of 
all the pixels composing the image signal 83. The block selection portion 32 classifies the image signal 83 which has 
been subjected to the subtraction processing in the mem difference ^subtraction portion 41 into a plurality of blocks in 

40 accordance with a previously determined block siize, and then classifies the blocks into groups each comprising one or 
two or more blocks in accordance with a previously det»irminad number of blocks. The quantization portion 33 finds, for 
each of the groups obtained by the classification in the block selection portion 32, a mean value M of the values of the 
pixels composing each of the blocks in the group. The quantization portion 33 subjects the found mean value M to linear 
quantization using a previously determined quantization step-size Q, \o calculate a quantization value q. The digital 

45 Information judgment portion 22 judges whether each of the quanlizaticn value qs which are calculated in the quantiza- 
tion portion 33 is even or odd. and judges the logical value of the embedded digital information on the basis of the judg- 
ment. 

[0260] By the above-mentioned construction, the digital information extracting apparatus 3b according to the sixtti 
enri)odiment can accurately extract the embedded digital information, 9S described in the fouilh embodiment, even 
so when tiie digital information embedding processing described in the above-mentioned third embodiment has been per- 
formed with respect to the block where the inputted image signal is not subjected to discrete cosino transform. Fourier 
transform or Hadamard transform. 

(Seventh Embodiment) 

65 

[0261 ] Rg. 1 9 is a block diagram showing the construction of a digital irifornrtation enrjbedding apparatus according to 
a seventh embodiment of the present invention. In Fig. 19. the digital infbrmation embedding apparatus 4a comprises 
a band division portion 1 1 , a map information generation portion 52, a signal replacement portion 53, and a band syn- 
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thesis portion 17. 

[0262] The band division portion 1 1 and the band synthesis portion 1 7 in the digital information embedding apparatus 
4a according to the seventh embodiment respectively have the same structures as the band dividing device 11 
desalbed in the above-mentioned prior art and the band synthesis portion 17 in the digital information embedding 
5 apparatus la according to the first embodiment, and are assigned the same reference numerals and hence, the 
desaiption thereof is not repeated. 

[0263] The band division portion 1 1 receives a digitized image signal 71 , and divides the image signal 71 into 10 fre- 
quency bands, i.e., an LL3 signal. LHi signals. HLi signals and HHi signals by discrete wavelet transform, to calculate 
respective transform coefficients. The map information generation portion 12 generates, with respect to a third hierar- 

10 chical signal (excluding the LL3 signal) obtained by the division in the band division portion 1 1 , map information indicat- 
ing whether or not the absolute amplitude values of ail the transform coefficients in the same space representation 
region In the same direction of division which conrespond to one arbitrary data in the signal are not more than a previ- 
ously determined set value R. The same space representation region in the same direction of division means a region 
comprised of signals in the same direction of band division in the band division portion 11, i.e., a region comprised of 

IS the LH3 signal, the LH2 signal and the LHI signal, or a region comprised of the HL3 signal, the HL2 signal and the HLI 
signal, a region comprised of the HH3 signal, the HH2 signal and the HHI signal. The signal replacement portion 53 
refers to each of the values of the map information generated in the map information generation portion 52, to replace, 
when the value is not more than the previously determined set value R. the transform coefficients with other numerical 
values in accordance with the digital information to be embedded. The band synthesis portion 17 synthesizes band 

20 component signals in a plurality of frequency bands which have been subjected to the embedding processing (i.e.. the 
replacement of the transform coefficients) in the signal replacement portion 53. to reconstruct an image signal 75. 
[0264] Referring to Figs. 20 to 22, description is made of a method of embedding digital information carried out by the 
digital information embedding apparatus 4a. 

[0265] Fig. 20 is a ftow chart showing processing performed in the map information generation portion 52. Fig. 20 

^ shows as an example a case where map information relating to tlie HL3 signal which is high in its horizontal component 
and is low in rts vertical component is generated. Fig. 21 is a diagram for explaining the generation of the map informa- 
tion. Rg. 22 is a flow chart showing processing performed in the signal replacement portion 53. 
[0266] Description is now made of processing performed in the map information generation portion 52. 
[0267] Referring to Fig. 20. the map information generation portion 52 selects one transform coefficient in an arbitrary 

30 position of the HL3 signal on the basis of an output of the bsnd division portion 1 1 (step S200 1 ). Transform coefficients 
in the same space representation region in the same direction of division as the selected transform coefficient in the 
HL3 signal are extracted (step S2002). The transform coefl icients in the same space representation region in the same 
direction of division with respect to the HIj3 signal are a total of 21 transform coefficients, i.e. , one transform coefficient 
in the HL3 signal, four transform coefficients in the HL2 signal, and 1 6 transform coefficients in the HLI signal (portions 

3S painted in black in Fig. 21 (a)). It is judged whether or not the absokfte amplitude value of each of the 21 transform coef- 
ficients is not more than a previously determined set value R (step S2003). The set value R can be arbitrarily deter- 
mined depending on the length of the digital information to be embedded, for example. When it is judged at the step 
S2003 that the absolute amplitude values of all the 21 transform coefficients are not more than the set value R, infor- 
mation "1" is set in map positions con*esponding to the positions of the transform coefficients (step S2004). On the other 

40 hand, when it is not judged at the step S2003 that the absolute amplitude values of all the 21 transform coefficients are 
not moTQ than the set value R. information "0" is set in the map positions con^esponding to the positions of the transform 
coefficients (step S2005). 

[0268] Thereafter, it is judged whether or not map information has been generated for all the transform coefficients in 
the HL3 signal. When there exists the transform coefficient for which no map inf 3rmation has been generated, the trans- 
45 form coefficient is selected, after which the program is returned to the foregoing step S2002, to repeatedly perform the 
same processing (steps S2006 and S2007). 

[0269] The map information goneratiori portion 52 performs the above-mentioned processing with respect to all the 
transform coefficient in the HL3 signal and the transform coefficients in the HL2 signal and the HL1 signal in the same 
space representation region in the same direction of division as the transform coefficient in the HL3 signal, to generate 

so map infbrmation of a size corresponding to the transform coefficient in the HL3 signal (see Fig. 21 (b)). 
[0270] Description is now made of processing performed in the signal replacement portion 53. 
[0271 ] Referring to Fig. 22. the signal replacement portion 53 refers to ififormation representing a position at the head 
of the map information generated by the map information generation portion 52 (tiis position at the head can be arbi- 
trarily determined) (step S2201). A counter n representing the position of a bit. in the digital i.iformation. to be embed- 

s$ ded (n takes a value in a range from one to the final bit in the digital information) is taken as one (step S2202). The 
digital information shall be a bit stream obtained by binary-coding the name of a copyright owner, the date for genera- 
tion, and 80 fburtii. It Is judged whether or not the map information in a position referred to is "r (step S2203). When 
the map infbrmation is "1 " in the judgment at the step S2203, It is further judged whether or not the logical xfalue of the 
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n-th bit, in the digital information, to be embedded In the position is "V (step S2204). When the logical value of the n-th 
bit Is T in the judgment at the step S2204, all the 21 transform coefficients in the same space representation region in 
the same direction of division with respect to the HL3 signal which correspond to the above-mentioned position referred 
to are replaced with a value + K (plus K) (step S2205). Contrary to this, when the logical value of the n-th bit is "0" in 

5 the judgment at the step S2204, all the 21 transform coefficients In the same space representation region In the same 
direction of division with respect to the HL3 signal which correspond to the above-mentioned position referred to are 
replaced with a value - K (minus K) (step S2206). It is preferable that the absolute value of the value K is not more than 
the set value R in order to minimize the degradation of the image after the replacemeni processing of the transform 
coefficients. After the replacement processing is terminated with respect to the n-th bit, one is added to n in order to 

TO proceed to the subsequent bit in the digital information (step S2207). On the other hand, when the map information is 
"0" in the judgment at the step S2203. the replacement processing of tfie transfcrm coefficients is not performed. 
[0272] Thereafter, it is judged whether or not all positions cf the map information have been referred to. When there 
exists the position, which has not been referred to yet, of the map information, the position is refen'ed to, after which the 
program is returned to the foregoing step S2203, to repeatedly perform the same processing (steps S2208 and S2209). 

15 [0273] The signal replacement portion 53 performs the above-meniioned processing with respect- to ail the positions 
of the map infbrnriation, and replaces only the transform coefficients in the positions in which the digital information is to 
be enr4)edded out of the transform coefficients in the HL3 signal, the HL2 signal and the HL1 signal with the value + K 
or the value - K. 

[0274] The number of bits composing the digital information to be embedded and the number of positions where the 
20 map information is "1 " do not necessarily coincide with each other. Contrary to this, when the number of bits composing 
the digital information is smaller than the number of positions wtiere the map information is "1", methods such as a 
method of embedding all bits composing the digital informcition, and then continuously embedding the bKs. starting with 
the first bit. and a method of embedding a bit "0 (or 1)*' in all the remaining positions where the map information is "1" 
are considered. When the number of t)its conposing the digital information is larger than tlie number of positions where 
^ the map information is "1", methods such as a method of ensuring positions, where the map information is "r, con^e- 
sponcfing to the number of bits composing tiie digital information by increasing the set value R and a method of contin- 
uously embedding bits which cannot be embedded in the region comprised of the HL signals In the region comprised 
of the LH signals are considered. 

[0275] As described In the foregoing, tiie digital information embedding apparatus 4a according to the seventh 
90 embodiment embeds tiie digital information in low frequency band signals over a plur^ility of hierarchies. Consequently, 
It is possible to prevent the embedded digital information from being lost against an attack for unauthorized utilization 
from a tiiird person. Further, the transform coefficients whose absolute amplrtude values are not mora than the set value 
R are replaced with the values + K which are set to not more than the set value R. Consequently, it is possible to reduce 
the effect on the degradation of the image at the time of extracting the embedded digital information, and it is difficult 
35 for the third person to detect the embedded digital information. 

[0276] The discrete wavelet transform performed in the digital information embedding apparatus 4a according to the 
seventh embodiment is not limited to three hierarchies. It can bo performed even many times until 'ihe LL signal reaches 
a 1 X 1 element. 

[0277] A value set in the map information generation portion 52 may be set to "0" in a case where the absolute ampli- 
40 tude values of the 21 transform coefficients in the same space representation region in the same direction of division 
are not more than tiie set value R, while being set to "1" in the other case. 

[0278] Furthermore, a value which is replaced with the transiform coefficient in the signal replacement portion 53 may 
be set to + K when the logical value of a bit, in the digital information, to be embedded is "0", whfile b€iing set to - K when 
the bit is "1". The replacement of the transform coefficieni may be not replacement of the value + K and the value - K 
45 but replacement of tiie value 4- K and the value 0. 

(Eightii Embodiment) 

[0279] Fig. 23 is a block diagram showing the construction of a digital information extracting apparatus according to 
so an eighth embodiment of the present invention. The digital information extracting apparatus 4b according to the eighth 
embodiment is an apparatus for extra(.1ing the digital information embtKfded by the above-mentioned digital Information 
embedding apparatus 4a according to the seventii embodiment. !n Fig. 7, tfie digital Information extracting apparatus 
4b comprises a band division portion 1 1 , a map information analysis portion 54, a coefficient calculation portion 55. and 
a digital information judgment portion 56. 
55 [0280] The band division portion 1 1 in the digital information exiracting apparatus 4b according tc the eighth embod- 
iment has the same structure as the tand division portion 1 1 in tlie digital information embedding apparatus 4a accord- 
ing to the seventh embodiment, and is assigned the same reference numeral and hence, the description thereof is not 
repeated. 
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[0281] The band division portion 11 rfjceives an image signal 84. The image signal 84 Includes. In addition to the 
Image signal 75 outputted by the band synthesis portion 17 In the digital infornmtion embedding apparatus 4a accord- 
ing to the seventh embodiment, the map information generated by the map information generation portion 52 in the dig- 
ital information embedding apparatus 4a. and the value K used for replacement in the signal replacement portion 53 In 

5 the digital information embedding apparatus 4a. The band division portion 1 1 subjects the inputted image signal 84 to 
discrete wavelet transform, to divide the image signal 84 into 10 frequency bands, i.e., an LL3 signal, LHI signals, HU 
signals and HHi signals, and calculate respective transform coefficients. The map information analysis portion 54 
extracts, on the fc>asls of the map information, 21 transform coefficients in the same space representation region in the 
same direction of division which correspond to the position where the map information is T . The coefficient calculation 

10 portion 55 calculates, using the transform coefficients included in one or two or more frequency bands out of the trans- 
form coefficients extracted in the map information analysis portion 54, a total value Y of the transform coefficients on 
the basis of the value K. The digital information judgment portion 56 judges the sign of the total value Y calculated In 
the coefficient calculation portion 55, to extract the embedded digital information on the basis of the judgment. 
[0282] Refen-ing now to Fig. 24, description is made of a digital information extracting method carried out by the digital 

15 Information extracting apparatus 4b. Fig. 24 is a flow chart showing processing performed in the map information anal- 
ysis portion 54, the coefficient calculation portion 55. and the digital information judgment portion 56. Rg. 24 shows as 
an example a case where map Information relating to thie HLS signal vi'hich Is high in its horizontal frequency component 
and Is low in its vertical frequency component is analyzed, to extract digi^ial information. 

[0283] Referring to Fig. 24, the map information analysis portion 54 refers to Information in a position at the head of 
20 the map information generated by the map information generation portion 52 (step S2401 ). It is judged whether or not 
the map information in a position referred to is T (step S2402). When tiie map information is "1 " in the judgment at tiie 
step S2402. all the transform coefficients in the HLS signal, the HL2 signal and the HL1 signiii in the same space rep- 
resentation region in the same direction of division which correspond to the map position are extracted (step S2403). 
The coefrident calculation portion 55 uses the transform coefficients included in the one or two or more frequency 
25 bands out of the 21 transform coefficients extracted at the st^ap S2403, that is. one or two or more signals out of the HL3 
signal, the HL2 signal and the HL1 signal, to calculate a total value Y of the transform coeffici<3nts (step S2404). On the 
other hand, when the map information is "0" in the judgmsiTt at ihe step S2402. no processing is performed. 
[0284] In calculating tiie total value Y "one or two or more signals out of the HLS signal, Ih 3 HL2 signal and the HL1 
signal" is defined in order to cope with a case where the sign of the transform coefficient is clianged due to any effect 
30 on high frequency bands, as describee' in the above-mentioned problems to be solved. For example, the effect on high 
frequency bands is most easily exerted on a shallow hierarchical signal, so that the total value Y may be calculated as 
follows using not the HL1 signal but only the HLS signal and the HL2 signial in order to increase tiie reliability of the total 
value Y: 

35 Y = (transform coefficient in HLS signal) x 4 + (sum of four transform coefficients in HL2 signal) 

TTie transform coefficient in the HLS signal is multiplexed by four in order to obtain a total value Y in higher reliability by 
weighting a deep hierarchical signal on which the effect on high frequency bands is not easily exerted. A method of cal- 
culating tine total value Y is not limited to the above-mentioned t-xample. It can be suitably and arbitrarily determined by 

40 the state of the inputted image signal 72. 

[0285] Referring to Fig. 24 again, the digital information judflmont portion 56 judges whelhor the sign of the total value 
Y calculated at the foregoing step S2404 is positive or negative (step S2405). ViTnen the sign of the total value Y is pos- 
itive in the judgment at the step S2405, It Is judged that the digital information embedded in positions of tiie transform 
coefficients whose total value Y has been calculated t£ikes a value *'1 " (step S2406). On the other hand, when the sign 

45 of the total value Y is negative in the judgment at the islep S2405, It is judged tliat the digital information eml>€dded in 
the positions takes a value "0" (step S2407). 

[0286] Thereafter, It is judged whether or not all positions of the map information have been referred to. When there 
exists the position, which has not been referred to yet, of the maip information, the position is referr ed to. after which the 
program is returned to the foregoing step S2402. to repeatedly perform tiie same processing (steps 32408 and S2409). 

so Consequently, the digital information is extracted and reprcduced. 

[0287] As described in tiie foregoing, the digital information extracting apparatus 4b according to the eighth embodi- 
ment judges the logical value of tiie embedded digital inforni:5iion by the results of ^^xtracting transform coefficients 
which have been embedded in a lo^/v frequency band which is hardly affected by data destruction in high frequency 
bands, and calculating the total value Y of the transform ooefficients using a previously determined method. Conse- 

ss quentiy. accurate digital Information can be extractod without being affected by an attack from an unauthorized user. 
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(Ninth Embodiment) 

[0288] Fig. 25 is a block diagram showing the construction of a digital information embedding apparatus according to 
a ninth embodiment of the present invention. In Fig. 26. the digital information embedding apparatus 5a comprises a 
5 band division portion 1 1 , a map information generation portion 61 , a signal transform portion 62, a signal replacement 
portion 63, and a band synthesis portion 17. 

[0289] The band division portion 1 1 and the band synthesis portion 1 7 in the digital information embedding apparatus 
5a according to the ninth embodiment respectively have the same structures as the band dividing device 1 1 and the 
band synthesis portion 1 7 in the digital information embedding apparatus 4a according to the seventh embodiment and 

10 are assigned the same reference numerals and hence, the description thereof is not repeated. 

[0290] The band division portion 1 1 receives a digitized image signal 71 , and divides the image signal 71 intolO fre- 
quency bands, i.e.. an LL3 signal, LHI signals. HU uigngls and HHi signals by discrete wavelet transform, to calculate 
respective transform coefficients. The map information generation portion 61 generates, with respcict to a third hierar- 
chical signal (excluding the LL3 signal) obtained by the division in the band division portion 1 1 , map information indicat- 

15 Ing whether or not the absolute amplitude values of the transform coefficients are between two set values which are 
previously determined. The signal transform poiHon 62 d<osignates a transform value to be embedded in accordance 
with digital information to be embedded and the sign of tho transform coefficient. The signal replacement portion 63 
replaces the transform coefficient with the transform value designated in the signal transform portion 62. The band syn- 
thesis portion 17 synthesizes the plurality of frequency bands which hava been subjected to the embedding processing 

20 in the signal replacement portion 63, to reconstruct an image signal 76. 

[0291 ] Refening to Figs. 26 to 28, description is made of a method of embedding digital information carried out by the 
digital information embedding apparatus 5a. 

[0292] Fig. 26 is a flow chart showing processing performed In the map information generation portion 61 . Fig. 26 
shows as an example a case where map information relating to the HL3 signal which is high in its horizontal frequency 
25 component and is low in Its vertical frequency component. F"ig. 27 is a diagram showing the contents of transformation 
designated by the signal transform portion 62. Fig. 28 is a flow chart shov^'ing processing performed in the signal 
replacement portion 63. 

[0293] Description is now made of the processing performed in the map information generation portion 61 . 

[0294] Referring to Fig. 26, the map information generation portion 61 selects ona transform cooff Icient in an arbitrary 

90 position of the HL3 signal on the basis of an output of the bnncl division portion 1 1 (step 82601}. !t is judged whether or 
not the absolute anplitude value c«f the transform coefficient Is within the range of not 1^?^ than a threshold value TL 
nor more than a threshold value TH (hereinafter referred to as a threshold range) (step S2602). The threshold values 
TL and TH can be arbitrarily determined depending on the length of digital information to be embedded, for example. 
When the absolute amplitude value is within the threshold range in the judgment at the step S2302, information "1" is 

35 set in a threshold map position corresponding to the position of the HL3 signal (step S2603). On the other hand, when 
the absolute amplitude value is not within the threshold range in the judgment at the step S2602. information "0" Is set 
in the threshold map position conresponding to the position of the HL3 signal (step S2604}. Thereafter, it is judged 
whether or not map information has been generated wKh respect to all the transform coefficients In the HL3 signal. 
When there exists the transform coefficient for which no map Information has been generated, the transform coefficient 

40 is selected, after which the program is returned to the foregoing step S2602, lO repeatedly perform the same processing 
(steps S2605 and S2606). 

[0295] The map information generation portion 61 performs the above-mentioned processing with respect to all the 
transform coefficients in the HL3 signal, to generate mr:q:i information cf a size con'espondimj to the transform coeffi- 
cients In the HL3 signal. The map Information is basicaJy the same as the map information generated b> the map infbr- 
45 mation generation portion 52 according to the seventh embodiment except for a threshold value (a set value) for judging 
a logical value. 

[0296] Description Is now made of processing performed In the signal transform portion 62. 

[0297] The signal transform portion 62 Issues an Instruction to perform transformation based on a combination of the 

sign of a transform coefficient and tiie logical value of a bit, in digital information, to be embedded, e.s shown in Fig. 27. 

so Rg. 27 means that in a case where a transform coefficient in a position refened to is positive, a transform value is + A 
(plus A) when the logical value of a bit, in digital infbrmation, to be embedded in the position is "1 v</hlle being + B (plus 
B) when the logical value is "0", and means that in a case where a tran^jform coefficient in a pc^nition refen-ed to is neg- 
ative, a transform value is - A (minus A) when tha logical value of a bit. in digital information, to be embedded In the 
position is "r. while being - B (minus B) when the logical value is "0". It Is preferable that the absolute values of the 

55 value A and the value B are set witiiin the above-men Honed threshold range (TL < A and B < TH) in order to minimize 
the degradation of an image alter the replacement of thn irar^sform coefficient. 
[0298] Processing performed in the signal replacement cortlon 63 will be dascribed. 

[0299] Refening to Fig. 28. the signal replacement portion 63 refers to infornrtation representing a position at ttie head 
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of the map information generated by the map information generation portion 61 (step S2801). A counter n representing 
the position of a bit, in the digital information, to be embedded (n takes a value in a range from one to the final bit in the 
digital information) is taken as one (step S2802). It is judged whether or not the map information in a {:)Osition referred 
tois "1" (step S2803). When the map information Is "1 " in the judgment at the step S2803, it is judged whether the sign 

5 of a transform coefficient in the position referred to Is positive or negative, and it is judged whether the logical value of 
the n-th bit, in the digital Information, to be embeddei j in the position is "1 " or "0" (step S2804). The transform coefficient 
is replaced with transform value (either ± A or + B) in accon iance with the results of the judgment at the step S2804 and 
the instruction to perform transformation issued by the signal transform portion 62 (step S2805). After the replacement 
processing is terminated with respect to the n-th bit, one is added to n in order to proceed to the subsequent bit in the 

w digital information (step S2806). On the other hand, when the map information Is "0" in the judgment at the step S2803, 
the replacement processing of the transform coefficient is nol performed. 

[0300] Thereafter, it is judged whether or not all positions of the map information have been referred to. When there 
exists the position which has not been referred to yet, of the map information, the position is referred to, after which the 
program is returned to the foregoing step 32803, to repeatedly perform the same processing (steps S2807 and S2808). 
15 [0301] The signal replacement portion 63 performs the above-mentioned processing with respect to all the positions 
of the map information, and replaces only the transform coefficient, in the positron in which tfie digital information is to 
be embedded, in the HL3 signal with either one of the values + A and values ± B. 

[0302] After the above-mentioned processing is performed, the ban-j synthesis portion 17 reconstruct the 10 fre- 
quency bands, i.e., the LL3 signal, the Lhli signals, the HU signais and the HHi signals as an image signal 76 which has 

20 been sut)jected to the embedding processing, as described above, to output the image signal 76. 

[0303] As described in the foregoing, the digital information eriibedding apparatus 5a according to ti"ie ninth embodi- 
ment embeds the digital information only in the transform coefficients in a deep hierarchical signal which is not easily 
affected. Consequently, it is possible to more satisfactorily prevent the embedded digital information from being lost 
against an attack for unauthorized utilization from a third person, as compared with the digital information embedding 

26 apparatus 4a according to the se/enth embodiment. Further, the transform coefficient urhose absolute amplitude value 
is within the range of not more than the threshold value TL nor more than the threshold value TH is transformed into a 
value within the threshold range considering the sign of the transform coefficient, so that it is possible to reduce the 
effect on the degradation of the image at the time of extracting the embedded digital inform.ation. and it is difficult for the 
third person to detect the embedded digital information. 

30 

(Tenth Embodiment) 

[0304] Fig. 29 is a block diagram showing the construction of a digital information extracting apparatus according to 
a tenth embodiment of the present invention. The digital infarmation sxtrcicting apparatus 5b according to the tenth 
35 emtxxJiment is an apparatus for extractincj the digital information embedded by the above-mentioned digital information 
en(t>6dding apparatus 5a according to the ninth embodiment. In Fig. 29, \he digital irvbrmation extracting apparatus 5b 
comprises a band division portion 1 1 , & map information analysis portion 64. an error calculation portion 65. and a dig- 
ital information judgment portion 66. 

[0305] The band division portion 1 1 in the digital information extrcXting apparatus 5b according to the tenth embodi- 
40 ment has the same structure as the band division portion 1 1 in lh3 digital information embedding apparatus 4a accord- 
ing to the seventh embodiment, and is assigned the same refsrence numeral and hence, the description thereof is not 
repeated. 

[0306] The band division portion 1 1 receives an image signal 85. The image signal 85 Includes, in addition to the 
image signal 76 outputted by the band synthesis portion 17 in the digital information embedding apparatus 5a accord- 

45 ing to the ninth embodiment, the map information generated by the map information generation portion 61 in the digital 
information embedding apparatus 5a. mH the transform valuos A and B designated in the signal transform portion 62 
in the digital information embedding apparatus 5a. The band dis'ision pnrii.on 1 1 si;bjects the inputted image signal 85 
to discrete wavelet transform, to divide the image signal 85 into 10 frequency bands, i.e., an LIS signal, LHi signals, HLi 
signals and HHi signals, and calculate respective transform a)efficifinls. The map information analysis portion 64 

so extracts, on the basis of the map information, a transform coefficient con^esponding to the position wherD the value of 
the map information is ''I The en-or calculation portion 65 calculates errors between an absolute amplitude value C of 
the transtomi coefficient extracted in the map information analysis portion 64 and the transform values A and B. The 
digital information judgment portion 66 judges whether the logical value of a bit, in digital inforrnalion, embedded in the 
transform coefficient is "1" or "0" from the errors calculated in the error c=Llcu!ation portion 65, to extract the digital infor- 

55 mation. 

[0307] Refenring now to Fig. 30. description is made of a digital information extracting method carried out by the digital 
information extracting apparatus 5b. Fig. 30 is a flow chart shov/ing processing performed in the map information anal- 
ysis portfon 64, the error calculation portion 65, and the digital information judgment portion 66. Fig. 30 shows as an 
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example a case where map information relating to the HI-3 signal which is high in its horizorrtal frequency componertt 
and is low in its vertical frequency component is analyzed, to extract digital information. 

[0308] Referring to Fig. 30, the map Information analysis portion 64 refers to information in a position at the head of 
the map information generated by the map information generation portion 61 (step S3001}. It is judged whether or not 
5 the map information in a position referred to is "1 " (step S3002). Wien the map infbmiation is "1 " in the judgment at the 
step S3002, a transform coefficient, which corresponds to the map position, in the HL3 signal is extracted (step S3003). 
The error calculation portion 65 calculates the following absolute errors D1 and D2 from the absolute amplitude value 
C of the transfer coefficient extracted at the step S3003 and the transform values A and 6 designated in the signal trans- 
form portion 62 (step S3004): 

10 

D1 =|C-A|. andD2 = |C-B| 

The digital information judgment portion 66 compares the values of the absolute errors 01 and D2 calculated in the 
error calculation portion 65 (step S3005). In the comparison at the step S3005, when the value of D1 is smaller than 
75 the value of D2, it is judged that the digital information embedded in a position of the extracted transform coefficient is 
"1" (step S3006). Contrary to this, in the comparison at the step 83005. when the value of D2 is smaller than the value 
of D1 . it Is judged that the digital information embedded in the position is '*0" (step S3007). On the other hand, when the 
map information is "0" in the judgment at the step S3002, no processing is performed. 

[0309] Thereafter, it is judged whether or not all positions of the map Information have been referred to. When there 
20 exists the position, which has not been referred to yet, of the map information, the positionjs refen'ed to, after which the 
program is returned to the foregoing step S3002, to ref^eatedly perform the same processing (steps S3008 and S3009). 
Consequently, the digital information is extracted and reproduced. 

[0310] As described in the foregoing, the digital information extracting apparatus 5b according to the tenth embodi- 
ment judges the logical value of the embedded digital information by the results of extracting a transform coefficient 
25 which has been embedded in a deep hierarchical signal which is not affected by data destruction in high frequency 
bands, calculating the absolute en'ors D1 and D2 of the transform coefficient using a previously determined method, 
and comparing the absolute errors with each other. Consequently, accurate digital information can be extracted wrthout 
being affected by an attack from an unauthorized user. 

30 (Eleventh Embodiment) 

[031 1 ] Fig. 31 is a block diagram showing the construction of a digital infornnation embedding apparatus 6a according 
to an eleventh embodiment of the present Invention. In Fig. 31 , the digital information embedding apparatus 6a com- 
prises an orthogonal transform portion 31, a map information generation portion 61, a signal transform portion 62, a 

35 signal replacement portion 63, and an inverse orthogonal transform portion 36. 

[0312] As shown in Fig. 31 , the digital Information embec^ding apparatus 6a according to the eleventh embodiment is 
80 constructed that the band division portion 1 1 and the band synthesis portion 1 7 In the digital information embedding 
apparatus 5a according to the ninth embodiment are respectively replaced v/ith the orthogonal transform portion 31 and 
the inverse orthogonal transform portion 36. The orthogonal transform portion 31 and the inverse orthogonal transform 

40 portion 36 respectively have the same structures as the orthogonal transform portion 31 and the inverse orthogonal 
transform portion 36 in the digital information embedding apparatus 2a according to the third embodiment, and are 
assigned tiie same reference numerals and hence, the description thereof is not repeated. 
[0313] The ortiiogonal transform portion 31 receives an image signal 71 . and divides the image signal 71 into a plu- 
rality of blocks in accordance with a previously determined tHock size, and then subjects the signal in each of tiie blocks 

4S to orthogonal transform, to respectively calculate transform coefficienls In the block. The map information generation 
portion 61 generates the above-mentioned map infornrje.tlon using respective Iransform coefficients having components 
other ttian DC conponents out of transform coefficients calculated in the orthogonal transform portion 31 . It is desirable 
that tiie transform coefficients uned herein are respective transform coefficients having lower frequency components in 
order to withstand an attack from a third person. The invarj-e orthogonal transform porti^^n 36 subjects the transform 

50 coefftoients after embedding processing to inverse orthogonal! transfo! m, and reconstructs an image signal 77, to output 
the image signal 77. 

[0314] As described In the foregoing, the digital information embedding apparatus 5b according to tiie eleventh 
embodiment can also perform the above-mentioned digital information embedding processing described in ttie nintti 
embodiment with respect to the input of the image signal 71 v/hich has been subjected to discrete cosine transform, 
55 Fourier transform or Hadamard transform. 
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(Twelfth Embodiment) 

[0315] Fig. 32 is a block diagram showing the construction of a digital information extracting apparatus 6b according 
to a twelfth embodiment of the present invention. The digital information extracting apparatus 6b according to the twelfth 
5 embodiment Is an apparatus for extracting the digital information embedded by the above-mentioned digital information 
embedding apparatus 6a according to the eleventh embodiment. In Fig. 32, the digital information extracting apparatus 
6b comprises an orthogonal transform portion 31, a map information analysis portion 64, an error calculation portion 
65, and a digital information judgment portion 66. 

[0316] As shown in Fig. 32, the digital information extracting apparatus 6b according to the twelfth embodiment is so 
10 constructed that the band division portion 11 in the digital information extracting apparatus 5b according to the tenth 
embodiment is replaced with the orthogonal transform portion 31 In the digital information embedding apparatus 6a 
aocording to the eleventh embodiment. 

[0317] The orthogonal transform portion 31 receives an image signal 86. The image signal 86 includes, in addition to 
the image signal 77 outputted by the inverse orthogonal transform portion 36 in the digital information embedding appa- 

15 ratus 6a according to the eleventh embodiment, the map information generated by the map information generation por- 
tion 61 in the digital information embedding apparatus 6a, and the transform values A and B designated in the signal 
transform portion 62 in the digital information embedding apparatus 6a. The orthogonal transform portion 31 divides the 
inputted innage signal 86 into a plurality of bfocks in accordance with a previously determined blodc size, and then sub- 
jects the signal in each of the blocks to orthogonal transform, to respectively calculate transform coefficients In the 

20 block. The map Information analysis portion 64 extr£cts, on the basis of the map information, a transforn'i coefficient cor- 
responding to a position where the value of the map information is "V. The error calculation portion 65 calculates en'ors 
between an absolute amplitude value C of the transform coefficient extracted in the map information analysis portion 
64 and the transform values A and B. The digital information judgment pcrlion 66 judges whether the logical value of a 
bit. in the digital information, embedded in the transform coefficient is "1" or "0" from the en-ors calculated in the en^or 

25 calculation portion 65, to extract the digital information. 

[0318] By the above-mentioned construction, the digital information extracting apparatus 6b according to the twelfth 
enfibodiment can accurately extract the embedded digital information, as described in the tenth embodiment, even 
when the image signal 77 which has been subjected to disc^rete cosine transform, Fourier transform or Hadamard trans- 
form is subjected to the above-mentioned digital information ernbsdding pr(icessing described in the ninth eml^odiment. 

30 [0319] Typically, each of functions reali;2ed by the digital information embedding apparatuses and extracting appara- 
tuses according to the first to twelfth embodiments is realized by a storage device (a ROM, a RAM, a h9.rd disk etc.) 
storing predetermined program data and a CPU (Central Processing lini!) for exGcuting the program data. In this case, 
each of the program data may be introduced through a recording medium such as a CD-ROM or a floppy disk. 
[0320] Although the present invention has been described and iliustrated in detail, it is clearljr understood that the 

35 same is by way of illustration and example only and is not to be taken by way of limitation, the spirit and scope of the 
present Invention being limited only by the terms of the api:>endi3d claims. 

dalms 

40 1 . A digital information embedding apparatus for embedding inherent digital information in a digital image signal, com- 
prising: 

band division means for dividing said digital image signal into transform coefficients over a plurality of fre- 
quency bands using either discrete 'Afavelet transform or sub -band division; 

45 block division means for dividing the lowest frequency band out of said pluralit)^ of frequency bands obtained 

by the division into a plurality of blocks in accordance with a prerioi isly determined block size; 
quantization means for calculciting for each of said blocks a nrioan value M of the transform coefficients in the 
block, and subjecting the mean value M to linear quanti;?ation ufT.ing a pi eviously determined quantization step- 
size Q (Q is an integer of not less than one), to calculate a quanti?:ation value; 

so signal replacement means for replacing for each of said blocks, on the basis of said quantization value and the 

value of said digital information to be embedded which correspond to the block, the quantization value; 
mean difference addition means for subjecting for each of said blocks said replaced quantization value to 
inverse linear quantization using said quantization Rtcp-size Q to calculate a mean value M*, and adding a dif- 
ference DM (= M' - M) between the mean value M' and said mean value M to all th€) transform coefficients in 

55 the block; 

mean calculation means for calculating a mean value LM of the transform coefficients in tlie lowest frequency 
band after the addition c«f said diiYerence DM; arid 

band synthesis means for reconstructing a digital image signal in wliich said digital Information has been 



44 



EP0 920185A2 



embedded using the lowest frequency band after the addition of said difference DM and the other frequency 
bands. 

A digital information emb^ding apparatus for embedding inherent digitai information in a digital image signal, com- 
prising: 

orthogonal transform means for dividing said digital imag^ signal into a plurality of blocks each composed of a 
plurality of pixels previously determined, and subjecting, for each of the blocks, the block to orthogonal trans- 
form, to calculate transform coefficients; 

block selection means for further classifying said plurality of blocks obtained by the division into groups each 
conrprising one or two or more blocks in accordance with a previously determined number of blocks; 
quantization means for extracting, for each of the blocks bolonging to each of said groups, the transform coef- 
ficient having the lowest frequency component (hereinafter refeired to as a DC component) out of the trans- 
form coefficients in the block and calculating a mean valiio N/1 of the respective DC coiTponents in the blocks, 
and subjecting the mean value M to linear quantization using a previously determined quantization step-size Q 
(Q is an integer of not less than one), to calculate a quantization value; 

signal replacement means for replacing for ea<.h of said groups, on the basis of said quantization value and the 
value of said digital information to be embedded which correspond to the group, the quantization value; 
mean difference addition means for subjecting for each of said groups said replaced quantization value to 
inverse linear quantization using said quantization st9p-sixe Q to calculate a mean value M', and adding a dif- 
ference DM (= M' • M) between the mean value M' and said mean value M to all tha DC components in the 
blocks belonging to the group; 

Inverse orthogonal transform means for subjecting the plurality of blocks after the addition of said difference 
DM to Inverse orthogonal transform, to reconstruct a digital image signal in which said digKal information has 
been enr^edded; and 

mean calculation means for calculating a mean value LM of the amplitude values of the pixels in said recon- 
structed digital image signal. 

The digital information embedding apparatus according to dairfi wherein 

sakj orthogonal transform means performs signal transformation which is any one of discrete cosine transform, 
Fourier transform and Hadamard transform. 

A digital information embedding apparatus for embedding inherent digital Information in a digital image signal, com- 
prising: 

block selection means for dividing said digital image signal into a plurality of blocks each composed of a plural- 
ity of pixels previously detennined; 

quantization means for calculating for each of said blocks a mean value M of the pixelr. composing the block, 
and subjecting said mean value M to linear quantization using a previously determined quantization step-size 
Q (Q is an integer of not less than one), to calculate a quantization value; 

signal replacement means for replacing for each of said blocks, on the basis of said quantization value and the 
value of said digital information to be enibecjded which correspond to the block, the quantization value; 
mean difference addition moans for subjectirig lor each of said blocks said replaced quantization value to 
inverse linear quantization uning said quantization step-size Q to calculate a mean value M\ and adding a dif- 
ference DM (s M* - M) between the mean value M' and said mean value M to.all tiie pixels composing tiie block; 
and 

mean calculation means for calculating a mean value LM of tiie anpiitude values of the pixels in tiie digital 
image signal after the addition of said difference DM. 

The digital Information embedding apparatus according to claim 1, wherein 

said signal replacement means replaces said quantization value with an odd value closest to the value of (M/Q) 
when each of bits composing said digital information takes a logical value 1, while replacing the quantization 
value with an even value closest to the value of (M/Q) when raid bit takes a logical value 0. 

The digital information embedding apparatus according to daim 2, 'whr?rein 
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said signal replacement means replaces said quantization value with an cxid value closest to the value of (M/Q) 
when each of bits composing said digital information takes a logical value 1, while replacing the quantization 
value with an even value closest to the value of (M/Q) when said bit takes a logical value 0. 

5 7. The digital information embedding apparatus according to claim 3. wherein 

said signal replacement means replaces said quai rtization value with an odd value closest to the value of (MAD) 
when each of bits composing said digital information takes a loc^ical value 1. while replacing the quantization 
value with an even value closest to the value of (M/Q) when said bit takes a logical value 0. 

10 

8. The digital information embedding apparatus according to claim 4, wherein 

said signal replacement means replaces said quantization value with an odd value closest to the value of (M/Q) 
when each of bits composing said digital information takes a logical value 1 , while replacing the quantization 
IS value with an even value closest to the value of (M/Q) when siiid bit takes a logical value 0. 

9. A digital information extracting apparatus for extracting inherent digital information embedded by a particuiar appa- 
ratus in transform ooeffk:ients in the lowest frequency band obtained by dividing a digital image signal using either 
discrete wavelet transform or sub-band division, wherein the digital image signal outputted by said particular appa- 

20 ratus and a quantization step-size are Inputted, comprising: 

band division means for dividing said digital image signal into transform coefficients over a plurality of fre- 
quency bands using either discrete wavelet transform or sub-band division; 

block division means for dividing the lowest frequency band out of said plurality of frequency bands obtained 
25 by the division into a plurality of blocks in accordance with a previously determined block size; 

quantization means for calculating for each of said blocks a. mean value M of the transform coefficients in the 
block, and subjecting lha mean value M to linear quantization using the previously datermined quantizatton 
step-size Q, to calculats a quanti;!ation value; and 

digital information judgment means for judging whether said quantization value is even or odd, to extract the 
30 embedded digital information on the basis of the results of the judgment. 

10. A digital information extracting apparatus for extracting inherent digital information embedded by a particular appa- 
ratus in transform coefficients in the low«nst frequency l>,and obtained by dividing a digital image signal using either 
discrete wavelet transform or sub-band division, where in the digital image signal outputted by said particular appa- 

35 ratus, a quantization step-size, and a mean value LM of the transf()rm coefficients in the Icwest frequency band at 
the time of output are inputted, comprising: 

band division means for dividing said digital image signal into transform coefficients over a plurality of fre- 
quency bands using either discrete wavelet transform or sub-band division; 
40 mean difference subtraction means for calculating a mean value L.M' of the transform coefficients in the lowest 

frequency band out of the plurality of frequency bands obtained by the division, and subtracting a difference 
DM (= LM' - LM) between the mean value LM' and said mean value LM from all the transform coefficients in 
tfie lowest frequency band; 

block division means for dividing the lowest frequency band after the subtraction of said difference DL into a 
46 plurality of blocks in accordance with a previously determined block size; 

quantization means for calculating for each of said blockr, a mean value M of the transform coefficient in the 
block, and subjecting the rn-s an value M to linear quantization using Scild quantization step -size Q, to calculate 
a quantization value; and 

digital information judgment meims for judging whether said quantization value is even or odd. to extract the 
so embedded digital information on the basis of the results of the judgment. 

11. A digital Information extracting apparatus for extracting inherent digital information embedded by a particular appa- 
ratus in transform coefficients obtained by subjecting a digital image signal to signal transformation which is any 
one of discrete cosine, transform, Fourier transform, and Hadamard transform, then dividing the digital image signal 

55 into blocks, and subjecting each of the blocks to orthogonal transform, v/hersin the digital image signal outputted 
by said particular apparatus and a quantization step-size are inputted, comprising: 

orthogonal transform means for dividing said digital image sif^nal into a plurality of blocks each composed of a 
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plurality of pixels previously determined, and subjecting, for each of the blocks, the block to orthogonal trans- 
form, to calculate transform coefficients; 

block selection means for further classifying said plurality of blocks obtained by the division into groups each 
comprising one or two or more blocks in accordance with a previously determined number of blocks: 
5 quantization means for calculating for each of said groups a mean value of the respective transform coeffi- 

cients having the lowest frequency components in the blocks belonging to the group, and subjecting the mean 
value to linear quantization using the previously determined quantization step-size, to calculate a quantization 
value; and 

digital information judgment means for judging whether said quantization value is even or odd, to extract the 
10 embedded digital information on tiie basis of the results of the judgment. 

12. A digital information extracting apparatus for extracting inherent digital information embedded by a particular appa- 
ratus in transform coefficients obtained by subjecting a digital image signal to signal transformation which is any 
one of discrete cosine transform. Fourier transform and Hadamard transform, then dividing the digital image signal 

15 into blocks, and subjecting each of the blocks to ortiiogonal transform, wherein the digital image signal outputted 
by saKi particular apparatus, a quantization step-size, and a mean value LM of the amplitude values of pixels in the 
digital image signal at the time of output are inputted, comprising: 

mean difference subtraction means for calculating a mean va!ue LWi" of the amplitude values of the pixels in 
20 said digital image signal at the time of input, and subtracting a difference DM (= LM' - LM) between the mean 

value LM' and said mean value LM from the values of all the pixels in the digital image signal; 
ortiiogonal transform means for dividing said digital image signal after the subtraction of said difference DL into 
a plurality of blocks each composed of a plurality of pixels previously determined, and subjecting, for each of 
the blocks, the block to orthogonal transform, to calculate transform coefficients; 
25 block selection means for furtiier classifying siid plurality of blocks obtained by tiie division into groups each 

comprising one or two or more blocks in accordance with a pre/iajsly determined number of blocks; 
quantization means for calculating for each of said groups a mean value of the respective transform coeffi- 
cients having the lowest frequency components in the blocks belonging to the group, and subjecting the mean 
value to linear quantization using the previously determined quantization step-size, to calailate a quantization 
30 value; and 

digital information judgment means for judging whether said quantization value is even or odd, to extract the 
embedded digital information on the basis of the results of the judgment. 

13. A digital information extracting apparatus for extracting inherent digital information embedded by a particular appa- 
35 ratus in a mean value of pixels composing each of blocks obtained by dividing a digital image signal, wherein the 

digital image signal outputted by said particular apparat'js and a quantization step-size are inputted, comprising: 

block selection means for dividing said digital ii nage signal into a plurality of blocks each composed of a plural- 
ity of pix3ls previously determined; 
40 quantization means for calculating for each of said bfocKs a meim value of the pixels composing the block, and 

subjecting the mean value to linear quantization using said quantization step-size, to calculate a quantization 
value; and 

digital information judgment means for judging whether said quantization value is even or odd, to extract the 
embedded digital information on tiie basis of the re^sutts of the judgment. 

45 

14. A digital information extracting apparatus for extracting Inherent digital information embedded by a particular appa- 
ratus in a mean value of pixels composing each of bloc^:s obtained by dividing a dig'rial image signal, wherein tiie 
digital image signal outputted by said particular apparatus, a quantization step-size, and a mean value LM of tiie 
amplitude values of the pixels in the digital image signal at the time of output are inputted, comprising: 

so 

mean difference subtraction means for calculating a mean value of the amplitude values of the pixels in 
said digital image signal at tiie time of input, and subtracting a difference DL LM' - LM) between the mean 
value LM* and said mean value LM from the values, of all the pixols. in the digital image signal; 
block selection means for dividing the digital image rignal after the subtraction of said difference DL into a plu- 
55 rality of blocks each composed of a plurality of pixels previously determined; 

quantization means for calculating a mean value of the pixels composing each of said blocks obtained by the 
division, and subjecting the mean value to linear quantization using said quantization step- size, to calculate a 
quantization value; and 
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digital information judgment means for judging wliether said quantization value is even or odd, to extract the 
embedded digital information on the basis of the results of the judgment. 

15. Adigital information embedding apparatus for embedding inherent digital information in adigital image signal, com- 
5 prising: 

band division means for dividing said digital image signal into transform coefficients over a plurality of fre- 
quency bands using either discrete wavelet transform or sub-band division; 

map information generation means for generating, with respect to each of the transform coefficients included 
10 in the one or two frequency bands out of said plurality of frequency bands obtained by the division, map Infbr- 

nnation storing a true/blse value based on decision whether or not all the absolute amplitude values of the 

transform coefficient and the other transform coefficients in the same space representation region in the same 

direction of division as the one or two frequency bands are not more than a previously determined set value; 

signal replacement means for replacing all of said transform cxDefncient and said other transform coefficients 
75 which correspond to the position where the true/false value of s>aid map information is true with a previously 

determined transform value on tlie basis of the value of said digital information to be embedded in the trans- 

Ibrm coefficients: and 

band synthesis means for synthesizing said plurality of transform coefficients after said replacement, to recon- 
struct a digital image signal. 

20 

16. The digital information embedding apparatus according to claim 15, wh&rein 

said transform value is set to integers ± K wfiich are not more than said !.>et value, and 
said signal replacement means replaces said transform coefficient and said other transform coefficients with 
25 the transform value + K when each of bits composing said digital information takes a logical value 1, while 

replacing the transform coefficients with the transform value - K when said bit takes a logical \^lue 0. 

17. The digital information embedding apparatus sccordlng to clairn 15, whierein 

30 said map information generation means generates the map information with respect to the transform coeffi- 

cients included in at least one or fc>oth of the frequency band which is law in its horizontal component and Is 
high in its vertical component and the frequency band which is high in its horizontal component and is low in 
its vertical component. 

35 18. The digital information embedding apparatus according to claim 1 6, wherein 

said map information generation means generates the map information with respect to the transform coeffi- 
cients included in at least one or both of the frequency band which is low in its horizontal component and is 
high in its vertical component and the frequency band which is high in its horizontal component and is low in 
40 its vertical component. 

19. A digital information embedding apparatus for embedding inherent digital information in a digital image signal, com- 
prising: 

45 band division means for dividing said digital image signal into transform coefficients over a plurality of fre- 

quency bands using either discrete wavelet transform or sub-band division; 

map information generation means for generating, with respect to each of the transform coefficients included 
in the one or two frequency bands out of said plurality of frequency bands obtained by the division, map infor- 
mation storing a true/false value based on decision whether or not the absolute amplitude value of the trans- 
50 form coefficient is included t^etween upper-limit sind lower-limit threshold values which are prsviously 

determined; 

signal replacement means for replacing said transform coefficient con^esponding to the position where the 
true/false value of said map information is true with a previously determined transform value on the basis of the 
sign of the transform coefficient and the value of said digital information to be ennbediJed in the transform coef- 
55 fident; and 

band synthesis means for synthosizing said plurality of transform coefficients after the replacement, to recon- 
struct a digital image signal. 
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20. A digital information embedding apparatus for embedding inherent digital information in a digital Image signal, com- 
prising: 

orthogonal transform means for dividing said digitai image signal into a plurality oi block signals of a previously . 
determined size, and subjecting, for each of t^^e block signals, the block signal to orthogonal transform, to cal- 
culate transform coefficients; 

map information generation means for generating, with respect to each of the transform coefficients included 
in the one or two block signals out of said plurality of block signals obtained by the division, map information 
storing a true/false value based on decision whether or not the absolute amplitude value of the transform coef- 
ficient is included between upper-limit and lower-limit threshold values which are previously determined; 
signal replacement means for replacing said transform coefficient corresponding to the position where the 
true^lse value of said map information is true with a previously determined transform value on the basts of the 
sign of the transform coefficient and the value of said digital information to be embedded in the transform coef- 
fident; and 

inverse orthogonal transform means for subjecting the plurality of transform coefficients after the replacement 
to Inverse orthogonal transform, to reconstruct a digital imago signal. 

21. The digital information embedding apparatus according to claim 20, wherein 

20 said orthogonal transform means performs frequency transformation which is any one of discrete cosine trans- 

form, Fourier transform and Hadamard transform. 

22. The digital information embedding apparatus according to claim 19, wherein 

2S said transform value is set to integers ± A and ± B between said upper-limit and lower-limit threshold values, 

and 

said signal replacement means replaces said transform coefficient with the transform value + A when each of 
bits composing said digital information takes a logical value 1 and the sign of the transform coefficient is posi- 
tive, with the transform value - A when said bit takes a logical value 1 and the sign of the transform coefficient 
30 is negative, with the transform value + B when said bit takes a logical value 0 and the sign of the transform coef- 

ficient Is positive, and wliti th*;} transform value - B when said bit takes a logical value 0 and the sign of the trans- 
form coefficient is negative. 

23. The digital information eml3edding apparatus according to claim 20, wherein 

said transform value is set to integers ± A and + B between said upper-limit and lower-limit threshold values, 
and 

said signal replacement means replaces said transform coefficient with the ti'ansform value + A when each of 
bits composing said digital information takes a logical value 1 and the sign of the transform coefficient is posi- 
tive, with the transform valuer - A when said bit takes a logical N^alue 'i and ihe sign of the transform coefficient 
is negative, with the transform valrje + B when s^ald bit takes a logical value 0 and the sign of the transform coef- 
ficient is positive, and with the transform value - B when said bit takes a logical value 0 and the sign of the trans- 
form coefficient is negative. 

45 24. The digital informalion embedding apparatus according to daim 21 , wherein 

said transform value Is set to integers ± A and ± B between said upper-limit and lower-limit threshold values, 
and 

said signal replacement means replaces said transform coefficient with the transform value + A when each of 
so bits composing said digital information takes a logical value 1 and the sign of the transform coeffident is posi- 

tive, with the transform value - A when said bit takes a logic^^t value 1 and the sign of the transform coeffident 
is negative, with the transform value + B when said bit takes a lo^csJ value 0 and the sign of the transform coef- 
fident is positive, and witli the transform value - B when said bit takes a logical value 0 and the sign of the trans- 
form coefficient is negative. 

55 

25. Tlie digital informaticn emb(:)dding apparatus according to daim 19. wherein 

said map information generation means generdtns the map information with respect to the respective trans- 



10 



35 



40 



49 



EP0920185A2 

Ibrm coefficients having the low frequency components other than the DC components. 

26. The digital information embedding apparatus according to claim 20, wherein 

s said map information generation means generates the map information with respect to the respective trans- 

fbrm coefficients having the tow frequency components other than the DC components. 

27. The digital information embedding apparatus according to claim 21 , wherein 

10 said map information generation means generates the map information with respect to the respective trans- 

form coefficients having the low frequency components other than the DC components. 

28. The digital information embedding apparatus according to claim 22, wherein 

IS said map information generation means generates the map information with respect to the respective trans- 

form coefficients having the low frequency components other than the DC components. 

29. The digital information embedding apparatus according to ciaim 23. wherein 

20 said map information generation means generates the map information with respect to the respective trans- 

form coefficients having the low frequency components other ihan the DC components. 

30. The digital information embedding apparatus according to claim 24. wherein 

25 said map infomiation generation means generates the map information with respect to the respective trans- 

form coefficients having the low frequency components other than the DC components. 

31 . A digital information e)ctracting apparatus for extracting inherent digiial information embedded by a particular appa- 
ratus in transform coefficients obtained by dividing a diQital imsige signal using either discrete wavelet transform or 

30 sub-band division, wherein the digital image signal outputted l)y said particular apparatus and nrtap information rep- 
resenting the position where said digital information is embedded are Inputted, comprising: 

band division means for dividing said digital image signal into transform coefficients over a plurality of fre- 
quency bands using either discrete wfavelel trarisforni or sub-t)and division; 
35 map information analysis means for extracting, or the basis of said map information, the transform coefficient 

corresponding to the position wfierD a true/false value of the miip Information Is true and the other transform 
coefficients in the same space representation region in the same direction of division as the frequency band 
including the transform coefficient; 

coefficient calculation means for calculating a total vs lue of the transform coefficients included in the one or two 
40 or more frequency bands out of said transform coefficient and said other transform coefficients which are 

extracted; and 

digital information judgnient means for judging the sign of said to-al value, to extract the embedded digital infor- 
mation on the basis of the results of the judgment. 

45 32. A digital information extracting apparatus for extracting inherent digital information embedded by a particular appa- 
ratus in transform coefficients obtained by dividing a digi1:a! Imc.ge signal using either discrete wavelet transform or 
sub-band division, wherein ths digital Image signal outpirtted by said particular apparatus, map information repre- 
senting the position where said digital information Is embcKlded. and information representing a transform value to 
be embedded are inputted, comprising: 

50 

band division means for dividing said image signal into transform coefficients over a plurality of frequency 
bands using either discrete wavelet transform or sub-band division; 

map information analysis means for extracting, on the basis of said inap informntion, said transform coefficient 
conespondlng to the position where a true/false value of the map information is true; 
55 enror calculation means for calculating an absolute error betv/eeit said extracted transform coefficient and said 

transform value; and 

digital information judgment means for judging the absolute e>Tor. to extract the embedded digital information 
on the basis of the results of the judgment 
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33. A digital information extracting apparatus for extracting inherent digital information embedded by a particular appa- 
ratus in transform coefficients obtained by subjecting a digital image signal to frequency transformation which is 
any one of discrete cosine transform, Fourier transform and Hadamard transform, then dividing the digrtal image 
signal into blocks, and subjecting each of the blocks to orthogonal transform, wherein the digital image signal out- 

5 putted by said particular apparatus, map information representing the position where said digital information Is 
embedded, and information representing a transform value to be embedded are inputted, comprising: 

orthogonal transform means for dividing said digital image signal into a plurality of block signals of a previously 
determined size, and subjecting, for each of the block signals, the block signal to orthogonal transform, to cal- 
culate transform coefficients; 

map information analysis means for extracting, on the basis of said map information, the transform coefficient 
corresponding to the position where a ttue/false value of ttie map information is true; 
error calculation means for calculating an absolute error between said extracted transform coefficient and said 
transform value; and 

digital information judgment means for judging tfie absolute error, to extract the embedded digital infbrmatlon 
on the basis of the results of the judgment. 

34. A digital information embedding method of embedding inherent digital infonnation in a digital image signal, com- 
prising the steps of: 

dividing said digital image signal Into transform coefficients over a plurality of 1requsnc>' bands using either dis- 
crete wavelet transform or sub-band division; 

dividing the lowest frequency band out of said plurality of frequency bands obtained by the division into a plu- 
rality of blocks in accordance with a previously determined block size; 

calculating for each of said blocks a mean value lA of the trttnsform coefficients in the block, and subjecting the 
mean value M to linear quantization using a pruvious-ly determined quantization step-size Q (Q is an integer of 
not less than one), to calculate a quantization value; 

replacing for each of said blocks, on the basis of sakj quanti:!:ation value and tha value of said digital informa- 
tion to be embedded which correspond to tha block, the quantization value; 

subjecting for each of said blocks said replaced quantization value to inverse linear quantization using said 
quantization step-size C to calculate a mean value M\ and adding a difference DM (= - M) between the 
mean value M' and said mean value M to all the transform coefficients in the block; 
calculating a mean value LM of the transform coefficients in the lowest frequency band after the addition of said 
difference DM; and 

reconstructing a digitcJ image signal in which said digital information has been embedded using the lowest fre- 
quency band after the addition of said difference DM and the other frequency bands. 

35. A digital information embedding method of embedding inherent digital information in a digital image signal, com- 
prising the steps of: 

40 

dividing said digital image signal into a plurality of blocks e\ioh composed of a plurality of pixelts previously 
determined, and subjectinQ for each of the blodte, the block to orthogonal transform, to calculate transform 
coefficients; 

further classif>'lng said plurality of blocks obtained by the division into groups each comprising one or two or 

45 more blocks in accordance with a previously determined number of blocks; 

extracting, for each of blocks belonging to each of ssid groLps. the transform coefficient having the lowest fre- 
quency component (hereinafter refen-ed to as a DC component) out of the transform coefficients in the block 
and calculating a mean value M of the respective DC i^omponsnts in the bloc!*s, and subjecting the mean value 
M to linear quantization using a previously determined quantization step-size Q (Q is an integer of not less than 

so one), to calculate a quantization value; 

replacing for each of ssid groups, on the basis o1 said quan'Jration value and the value of said digital informa- 
tion to be embedded which corraspond to tt^e group, the quantization value; 

subjecting for each of said groups said repiac ed quantization value to inverse linear quantization using said 
quantization step-size Q to calculate a mean vsJue M\ and adding a difference DM (=: M* - M) between the 
55 mean value M' and said mean value M to bM thG respective DO components In the blocks belonging to the 

group; 

subjecting the plurality of blocks after the addition of ^^id difference DM to In/erse orthogonal transform, to 
reconstruct a digital image signal in which said digital infbrm.slion has been embedded; and 
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calculating a mean value LM of the amplitude values of the pixels in said reconstructed digital image signal. 

36. The digital information embedding method according to claim 35. wherein 

5 said step of respectively calculating the transform coefficients performs signal transformation which is any one 

of disaete cosine transform, Fourier transform and Hadamard transform. 

37. A digital information embedding method of embedding inherent digital information in a digital image signal, com- 
prising the steps of: 

10 

dividing said digital image signal into a plurality of blocks each composed of a plurality of pixels previously 
determined; 

calculating for each of said blocks a mean value M of the pixels composing the block, and subjecting the mean 
value M to linear quantization using a previously determined quantization step-size Q (Q is an integer of not 
75 less than one), to calculate a quantization value; 

replacing for each of said biccks. on the basis of said quantization value and ^e value of said digital informa- 
tion to be embedded which correspond to the block, the quantization value; 

subjecting for each of said blocis said replaced quantization value to inverse linear quantization using said 
quantization step-size Q to calculate a mean value M'. and adding a difference DM (= M' - M) between the 
20 mean value M' and said mean value M to all the pixels composing the block; and 

calculating a mean value LM of the amplitude values of the pixels in th€ digital image signal after the addition 
of said difference DM. 

38. The digital information embedding method according tc claim 34, wherein 

said step of replacing the quantization value replaces said quantization value v/ith an odd value closest to the 
value of (M/Q) v/hen each of bits composing said digital information takes a logical value 1 , while r eplacing the 
quantization value with an even value closest to the value of (M/Q) when said bit takes a logical value 0. 

30 39. The digital information embedding method according to claim 35, wherein 

said step of replacing the quEnti:;ation value replaces said quantization value with an odd value closest to the 
value of (M/Q) when each of bits composing said digital information takes a logical value 1, while replacing said 
quantization valuf^ with an even \alue closest to the value of (M/Q) when said bit t&kes a logical value 0. 

3S 

40. The digital information embedding method according to claim 36, wherein 

said step of replacing the quantization value replaces said quantization value with an odd value closest to the 
value of (M/Q) when each of bits conposing said digital information takes a logical value 1 , while replacing the 
40 quantization value v/ith an even ^^lue closest to the value of (M/Q) when said bit takes a logical value 0. 

41. The digital information embedding mathod according to claim 37, wherein 

said step of replacing the quantization value replace.:; said quantization value with an odd value closest to the 
45 value of (M/Q) v/hen each of bits conposing said digital information 'iakes a logical '/alue 1 , while replacing the 

quantization value with an even value closest to the value of (M/Q) when said bit takes a logical value 0. 

42. A digital information extracting method of extracting inherent digital information embedded by a particular appara- 
tus in transform coefficients in the lowest frequency band obtained by dividing a digital image signal using either 

so discrete wavelet transform or sub-band division, wherein the digital image signal outputted by said particular appa- 
ratus and a quantization step-size are inputted, comprisirrg the steps of: 

dividing said digital image signal into transform coefficients over a plurality of frequency bands using either dis- 
crete wavelet transform or sub-band division; 
55 dividing the lowsst frequency band out of said pluralit/ of frequency bands obtained by the division into a plu- 

rality of blocks in accordance with a previously determined block size; 

calculating for each of said blocks a mean value M of the transform coefficients in the block, and subjecting the 
mean value M to linear quantization using the previoui-ly determined quantization £tep-size Q. to calculate a 
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quantization value; and 

judging whether said quantization value is even or odd. to extract the embedded digital information on the basis 
of the results of the judgment. 

43. A digital information extracting method of extracting inherent dtoitai information embedded by a particular appara- 
tus in transform coefficients in the lowest froquenq^ band obtained by dividing a digital image signal using either 
discrete wavelet transform or sub-band division, wherein the digital image signal outputted by said particular appa- 
ratus, a quantization step-size, and a mean value LM of the transform coefficients in the lowest frequency band at 
the time of output are inputted. a)mprising the steps of: 

dividing said digital image signal into transform coefficients over a plurality of frequency bands using either dis- 
crete wavelet transform or sub-band division; 

calculating a mean value LM' of the transform coefficients in the lowest frequency band out of the plurality of 
frequency bands obtained by the division, and subtracting a difference DM {= LM' - LM) between the mean 
value LM' and said mean value LM from all the transform coefficients in the lowest frequency band; 
dividing the lowest frequency band after the subtraction of said difference DL into a plurality of blocks in accord- 
ance with a previously determined block size; 

calculating for each of said blocks a mean value M of the transform coefficients in the block, and subjecting the 
mean value M to linear quantization usirig said quantization step-size Q, to calculate a quantization value; and 
judging whether said quaritizalion value is even or odd, to ejrtraC: the embedded digital information on the basis 
of the results of the judgment. 

44. A digital information extracting method of extracting inherent digital information embedded by a particular appara- 
tus in transform coefficients obtained by subjecting a digital Image signal to frequency transformation which is any 

25 one of discrete cosine transform. Fourier transform and Hadamard transform, then dividing the digital image signal 
Into blocks, and subjecting each of the blocks to orthogonal transform, wherein the digital image signal outputted 
by said particular apparatus and a quantization st^-size are inputted, conprising the steps of: 

dividing said digital image signal into a plurality o1 blocks each composed of a plurality of pixels previously 
determined, ard subjecting, for each of the blocks, the block to orthogonal transform, to calculate transform 
coefficients; 

further classifying said plurality of blocks obfe^ned by the division into groups each comprising one or two or 
more blocks in accordance with a previously deierrfiined number of blotfe; 

calculating for B<'ich of inaid groups a mean value of the respective iransform coefiicients having the lowest fre- 
quency components in the blocks belonging to the group, and subjecting the mean value to linear quantization 
using the previously determined quantization step-size, to calculate a quantization value; and 
judging whether said quantization value is even or odd, to extract the embedded digital information on the basis 
of the results of the judgment. 

40 45. A digital information extracting method of extracting inherent digital information embedded by £i particular appara- 
tus in transform coefficients obtained by subjecting a digital image signal to signal transformation which is any one 
of discrete cosin.3 transform, Fourier transform and Hacamard transform, then dividing tho digital image signal into 
blocks, and subjecting each of tho blocks to orthogonal transform, wherein the digital image signal outputted by 
said particular apparatus, a quantization step-size, and a mean value LM of the amplitude values of pixels in the 

45 digital image signal at the time of output are inputted, comprisirg the steps of: 

calculating a mem valuer L^'i' of the amplitude values of the pixels In said digit£'l image signal at the time of 
input, and subtracting a difference DM (■■= LM' - LM) betvi^een the mean value LM' and said mean value LM from 
the values of e.ll the pixels In the digital imago signal; 
so dividing said digital image signal after the subtraction of said difference DL into a plurality of blocks each com- 

posed of tf-ie plurality of pixels previously determined, and subjecting, for each of the blocks, the block to 
orthogonal transform, to calculate transform coefficients; 

further classifying said plurality of blodxS obtained by the dis'ision into groups each comprising one or two or 
more blocl^s in accordance with a previously determined number of blod-cs; 
55 calculating for each of said groups a mean valus of the respfjc;tive transform coefficients having the lowest fre- 

quency components in the blocks belonging to the group, and subjecting ths) mean \f&\ue to linear quantization 
using the previously determined quantizettion step-size, to calculate a quantization value; and 
judging whether s aid quanti^-ration value is even or odd. to G>1ract the embedded digital information an the basis 
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of the results of the judgment. 

46. A digital information extracting method of extracting inherent digital information embedded by a particular appara- 
tus in a mean value of pixels composing each of blocks obtained by dividing a digital image signal, wherein the dig- 
5 ital image signal outputted by said particular apparatus and a quantization step-size are inputted, comprising the 
steps of: 

dividing said digital image signal into a plurality of blocks each composed of a plurality of pixels previously 
determined; 

10 calculating for each of said blocks a mean value of the pixels composing the block, and subjecting the mean 

value to linear quantization using said quantization step-size, to <:alculate a quantization value; and 
judging whether said quantization value is even or odd. to extract the embedded digital information on the basis 
of the results of the judgment. 

IS 47. A digital information extracting method of extracting inherent digital information embedded by a particular appara- 
tus in a mean value of piijcels con-tposing each of blocks obtained by dividing a digital image signal, wherein the dig- 
ital image signal outputted by said particular apparatus, a quantization step-size^ and a mean value LM of the 
amplitude values of the pixels in the digital linage signal at the time cF output are inputted, comprising the steps of: 

20 calculating a mean value LM' of the amplitude values of the pixels in said digital image signal at the time of 

input, and subtracting a differance DL (= LM' - LM) between the mean value LM' and said mean value LM from 
the values of alt the pixels in the digital image signfi; 

dividing the digital image signal af^er the subtract! :>n of said difference DL into a plurality of biocKs each com- 
posed of a plurality of pixels previously determined; 
25 calculating a mean value of the pixels composing ecicf-i of the blocks obtained by the division, and subjecting 

the mean value to linear quantization using said quantization step-size, to calculate a quantization value; and 
judging whether said quantization value is even or odd, to extract the embedded digital information on the basis 
of the results of the judgment. 

30 48. A digital information embedding nvsthod of embedding inherent digital information in a digits! imagi} signal, com- 
prising the steps of: 

dividing said digital image signal into transform coefficients over a plurality of frequency bands using either dis- 
crete wavelet trfinsform or sub-band division; 

35 generating, with respect to each of the transform coefficients included in the one or two frequency bands out 

of said plurality of frequency bandts obtained by ^Mn division, mir^p information storing a true/false value based 
on decision whether or not al! the absolute amplitude values of the transform coefficient and the other trans- 
form coefficients in the same space representation region in the sane direction of division as the one or two 
frequency bands are not more than a previously determined set value; 

40 replacing all of said transform coefficient and said other transtt^rm coefficients whicti correspond to the position 

where the true/false value of said map information is true with a previously determined transform value on the 
basis of the value of said digital information to be embedde^j in the transform coefficients; and 
synthesizing said plurality of transform coefficients after said rcpl Jtcement, to reconstruct a digital image signal. 

45 49. The digital information embedding method according to claim 48, wherein 

said transform value is set to integers ± K which are not more than said set value, and 
said replacing step replaces f^a.id transform coefficient and said other transform coefficients with the transform 
value + K when each of bits composing r>;aid digilai information trikes a logical val'je 1, wiiile replacing the 
so transform coefficients with iho transform value - K when said bit takes a logical value 0. 

50. The digital Information embedding msthod accortling to claim 48, vvher.3!n 

said generating stop generates the map inforrnatior) with respect to the transform coefficients included in at 
ss least one or both of the frequnncy ban6 which Is low in its horizontal component and is high in its vertical com- 

ponent and the frecjuency hand v/hich is high in its horizontal oo Tiponeni and is low in itfi vortical component 

51. The digital information embedding method according to claim 49, wherein 
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said generating step generates the map Information with respect to the transform coefficients included in at 
least one or both of the frequency band which Is low In its horizontal component and is high in its vertical com- 
ponent and the frequency band which is high in its horizontal component and is low in its vertical component. 

52. A digital information embedding method of embedding Inherent digital information in a digital image signal, com- 
prising the steps of: 

dividing said digital image signal into transform coefficients over a plurality of frequency bands using either dis- 
crete wavelet transform or sub-band division; 

generating, with respect to each of the transform coefficients included in the one or two frequency bands out 
of said plurality of frequency bands obtained by the division, map information storing a true/lalso value based 
on decision whether or not the absolute amplitude value of the transform coefficient is included between upper- 
limit and lower-limit threshold values which are previously determined; 

replacing said transform coetf icient cofi'esponding to ti'^e posiiion where the true/false value of said map infor- 
mation is true with a previously determined transform value cn the basis of the sign of the transform coefficient 
and the value of said digit^i Information to be embedded in the transform coefficient; and 
synthesizing said plurality of transform coefficients after the replacement, to reconstruct a digital image signal. 

53. A digital information embedding method of embedding inherent digital information in a digital image signal, com- 
prising the steps of: 

dividing said digital image signal into a plurality of block signals of a previously determined size, and subjecting, 
for each of the block signals, the block signal to orthogonal transform, to calculate transform coefficients; 
generating, with respect to each of the transform coefficients Included In the one or two block signals out of said 

plurality of block signalr. obtained by the division, rnap inforriiation storing a true/false value based on decision 
whether or not the absolute amplitude value of the transfci m coefficient is Included in the range between 
upper-limit and lower-limii thteshold values which at e previously determined; 

replacing said transform ccjeff ici>i!nt cor responding to th =) position where the true/lslse value of said map infor- 
mation Is true with ?. previously d atermined transform vpJixe on Ihe basis of the sign of ths transform coefficient 
and the value of said digital Information to be embedded In the transform coefficient; and 
' subjecting said plurality of transform coefficients after the replacement to inverse orthogonal transform, to 
reconstruct a digital image signal. 

54. The digital information embedding method according to claim 53, wherein 

said calculating st^ performs frequency transformation whidi is any one of discrete cosine transform. Fourier 
transform and Hadamaixl transform. 

55. TTie digital Information em.b@dding method accordlnt^ to claim 52, wherein 

said transform value is set to Integers :i: A anci ± B bet/veen naid upper-limit and lower-limit threshold values, 
and 

said replacing stop replaces said transform coefficient with ttie Iransform value + A when each of bits compos- 
ing said digital infbrmation takes a logical value 1 and the sign of the transform coefficient Is positive, with the 
transform x'alue • A when said bit takes a logical value 1 and the sign of the transform coefficient Is negative, 
with the transform value + B when said bit takes a logical value 0 and the sign of the transform coefficient Is 
positive, and with the transform value • B when said bit takes a logical \^alue 0 and the sign of the transform 
coefficient is negative. 

56. The digital Information embedding method according to claim 53. wherein 

saki transform value is set to integers ± A and ± B between said upper-limit and lower-limit threshold values, 
and 

said replacing stop replncas saiil transv.Drm coefficient v/ith thn transform value -i- A vvhsn each of bits compos- 
ing said digital information takes a logical value 1 and the sinn of the transform coefficient is positive, with the 
transform value - A whsn said bit takes? a logical value 1 and iho. j-.ign of this transform coefficient is negative, 
with the transform value -i- B v/hen said bit takes a logical value 0 and the sign of the transform coefficient is 
positive, and ^ivith the transform value - B when said bit takes a logical value 0 and tlie sign of the transform 
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coefficient is negative. 

57. The digital information embedding method according io claim 54, wherein 

5 said transform value Is set to integers ± A and + B bet^A^een said ujcper-limit and lower-limit threshold values, 

and 

said replacing step replaces said transform coefficient with the transform value + A when each of bits compos- 
ing said digital information takr^s a logical value 1 and the sign of the transform coefficient is positive, with the 
transform value - A when said bit takes a logical value 1 and the sign of the transform coefficient is negative, 
10 with the transform value + B when said bit takes a logical value 0 and the sign of the transform coefficient is 

positive, and with the transform value - B when said bit takes a logical value 0 and the sign of the transform 
coefficient is negative. 

58. The digital information embedding method according to claim 52, wherein 

75 

said generating step generates the map informatio!i m\h r«3sp(^:t to the respective transform coefficients hav- 
ing the low frequency components other than the DC components. 

59. The digital information embedding method according to claim 53. wherein 

20 

said generating step generates the map information with respect to the respective transform coefficients hav- 
ing the low frequency conponcints otiier than the DC components. 

60. The digital information embedding method according to claim s54, wherein 

25 

sakl generating step generates the map Information with respect to the respective transform coefficients hav- 
ing the low frequency components other than the DC components. 

61. The digital information embedding msthod according to c'airn 55, v^herein 

30 

said map information generation means generat&s the map information with respect to the respective trans- 
form coefficients having the low frequency component?, other than tlie DC components. 

62. The digital intbrmation embedding method according to claim 55, wherein 

35 

said generating step generates the map Information with respect to the respective transform coefficients hav- 
ing the low frequency components other than the DC components. 

63. The digital information embedding method according to claim 57, wherein 

40 

said generating step generates the map information with respect to the respective transform coefficients hav- 
ing the low frequency componenls other than the DC componotTi;s. 

64. A digital information ejctracting msthod of extrticting inl'ierent digital information embedded by a particular appara- 
45 tus In transform coefficients obtained by dividing a digit£i! iinage signj^l using either discrete wavelet transform or 

sub-band division, wherein the digital image signal outputted by said iwticular apparatus and map Information rep- 
resenting the position where said digital informaticn Is embedded nin3 inputted, comprising the steps of: 

dividing said digital image signal into a plurality of frequency bs^nds to obtain transform coefficients using either 

so discrete wavelet transform or sub-band division; 

extracting, on the basis of said map information, the transform coefficient corresponding to the position where 
a true^lse value of the map information is true and the other transform coefficients in the same space repre- 
sentation region in the same direction of division as the frequency band Including the transform coefficient; 
calculating a total value of the transform coefficients included in the one or two or more frequency bands out 

55 of said transform coefficient and said other transform coefficient:; which are extracted; and 

judging the sign of said total value, to extract the embedded digital information on the basis of the results of the 
judgment 
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65. A digital information extracting method of extracting inherent digital information embedded by a particular appara- 
tus in transform coefficients obtained by dividing a digital image :3ignal using either discrete wavelet transform or 
sub-band division, vk/herein the digital image signal outputted by said particular apparatus, map information repre- 
senting the position where said digital information Is embedded. End information representing a transform value to 
5 be embedded are inputted, comprising the steps of: 

dividing said image signal into transform coefficients over a plurality of frequency bands using either discrete 
wavelet transform or sub-band division; 

extracting, on the basis of said map information, said transform coefficient corresponding to the position where 
10 a true^lse value of the map information is true; 

calculating an absolute eror between said extracted transform coefficient and said transform value; and 
judging the absolute error, to extract the embedded digital information on the basis of the results of the judg- 
ment. 

IS 66. A digital information extracling method of extracting inherent digital information embedded by a particular appara- 
tus in transform coefi'icients obtained by subjecting a digital image signal to frequency transformation which is any 
one of discrete cosine transform. Fourier transform and Hadamard transform, then dividing the digital image signal 
into blocks, and subjecting each of the blocks to orthogonal transform, wherein the digital image signal outputted 
by said particular apparatus, map information representing the position where said digital information is embedded, 

20 and Information representing a transform value to be embedded are inputted, comprising the st^ of: 

dividing said digital image signal into a plurality of block signals of a previously determined size, and subjecting, 
for each of the block signals, the block signal to orthogonal transform, to calculate transform coefficients; 
extracting, on the basis of said map information, the transform coefficient corresponding to the position where 
25 a true^lse value of the map information is true; 

calculating an absolute en^or between said extracted transform coefficient and said transform value; and 
judging the absolute error, to extract the embedded digital information on the basis of the results of the judg- 
ment. 

so 67. A recording medium having a program executed in a computer recorded thereon, the program realizing on said 
computer an operational environment comprising the steps of: 

dividing a digital image signal into a plurality r^f frec.uency bands to obtain transform coefficients using either 
discrete wavelet transform or sub-band division; 
35 dividing the lov/est frequency band out of said plurality of frequency bands obtained by the division into a plu- 

rality of blocks in accordance with a previously determined block size; 

calculating for each of said blocks a mean value M of the transform coefficients In the block, and subjecting the 
mean value M to linear quantization using a previously determined quantization step-size Q (Q is an integer of 
not less than one), to calculate a quantization value; 
40 replacing for each of said b'ccks. on the bas's of f?aid quanti:!ation value and the value of said digital informa- 

tion to be embedded which correspond to the blo»:k, the quantization value; 

subjecting for each of said blocks said replaced quantization value to inverse linear quantization using said 
quantization step-size Q to calculate a mean value M', and adding a difference DM {.- - M) between the 
mean value iVI' and said meai value M to ail the transform coefficients in the block; 
45 calculating a mean value IIA of the transform coe^icients in the lowest frequency band after the addition of said 

difference DM; and 

reconstructing a digital image signal in which said digital infor mation has been embedded using the lowest fre- 
quency band after the ndditic n of said difference DM and th€» other frequency bands. 

so 68. A recording medium having a program executed in a computer recorded thereon, the program realizing on said 
Gomputer an operational environment comprising the steps of: 

dividing a digital image signsJ into a plurality of blocks each f:cmp05ed of a plurality of pixels previously deter- 
mined, and subjecting, for each of the bioclcs. the block to orthogonal transform, to calculate transform coeffi- 
55 cients; 

further classifying said plurality of blocks obtainecf by the division into groups each cxjmjjrising one or two or 
more blocks in accordance with a pre/iously determined number of blocks; 

extracting, for each of the blocte: belonging to each of said groups, the transform coefficient having the kiwest 
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frequency conponent (hereinafter referred to as a DC component) out of the transform coefficients in the block 
and calculating a mean valu3 M of the respective DC components in the blocks, and subjecting the mean value 
M to linear quantization using a previously determined quantization step-size Q (Q is an integer of not less than 
one), to calculate a quantization value; 

replacing for each of said groups, on the basis of said quantizat'on value and the value of said digital informa- 
tion to be embeddtKi which correspond to the group, the quantization value; 

subjecting for each of said groups said replaced quantization value to inverse linear quantization using said 
quantization step-size Q to calculate a mean value M', and adding a difference DM (= M' - M) between the 
mean value M' and said mean value M to all the DC conponents in the blocks belonging to the group; 
subjecting the plurality of blocks after the additioi of said difference Dty^ to inverse orthogonal transform, to 
reconstruct a digital image signal in which said digital infbrmatiOii has been embedded; and 
calculating a mean value LM of the amplitude values of the pixels in said reconstructed digital image signal. 

69. The recording medium according to claim 68, wherein 

said step of respectively calculating the transforrri coefficients pcinorms signal transformation which is any one 
of discrete cosine transform, Fourier transform and Hadamard transform. 

70. A recording medium having a program executed in a computer recorded thereon, the program realizing on said 
oomputer an operational environment comprising the r>tet)s of: 

dividing a digital image signal into a plurality of blocks each composed of a plurality of pixels previously deter- 
mined; 

calculating for each of said blocks a mean value U of thts pixels composing the block, and subjecting the mean 
value M to linear quantization urting a pres'iously determined quantization step-size Q (Q is an integer of not 
less than one), to calculate a quantization value; 

replacing for each of said blocks, on the basis of said quantization value and the value of said digital informa- 
tion to be embedded which correspond to the block, the quantization value: 

sut^ecting for each of said blocks said replaced quaritize.tlon value to inverse linear qtanlizntion using said 
quantization step-size Q to calculate a mean value M', and bidding a difference DM M' - M) between the 
mean value M' and said mean value M to all the pixels conposing the block; and 

calculating a mean value LM of the amplitude '/alues of thQ pixels in tho digital image signal after the addition 
of said differance DM. 

71. Tlie recording medium accordrng to claim 67, wherein 

said step of replacing the qu^'intizaticn value repls ces S3iid quantization value with an odd value closest to the 
value of (MAD) when each of bits composing said digital information takes a logical \/a!ue 1 , while replacing the 
quantization value with an even >/aiud closest to the value of (M/Q) when said bit takes a logical value 0. 

72. The recording medium according to claim 68, wlierein 

said step of replacing the quantization value replaces said quantization ^/alue with an odd value closest to the 
value of (M/Q) when each of bits composing said digital information takes a logical value 1 , while replacing the 
quantization value with an even i-alue closest to the value of (M/Q) when said bit takes a logical value 0. 

73. The recording medium according to claim 69, wherein 

said step of replacing the quantization value replaces said quantization value with an odd value closest to the 
value of (M/Q) when each of bits composing said digital infornnaticn takes a logical vcJue 1 , while replacing the 
quantization value with an evon ^/alue dos-ist to the value of (M/Q) when said bit takes a logical value 0. 

74. The recording medium according to claim 70, wherein 

said step of replacing the quantization value replaces said quantization value with an odd value closest to the 
value of (M/Q) when each of bits composing said digital {nfGrma''on takes a logical value 1 . wh:le replacing the 
quantization ^mlue 'with an even value closest to the value of (M/Q) when said bit takes a logical value 0. 
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75. A recording medium having a program executed in a computer recorded thereon, the program realizing on said 
computer an operational environment comprising, with respect to a digital image signal having inherent digital infor- 
mation embedded by a particular apparatus in transform coefficients in the lowest frequency band obtained by 
dividing the digital image signal using either discrete wavelet transform or sub-band division, with using a quanti- 

5 zation step-size outputted by said particular apparatus, the steps of: 

dividing said digital image signal into transform coefficients over a plurality of frequency bards using either dis- 
crete wavelet transform or sub-band division; 

dividing the lowest frequency band out of said plurality of frequency bands obtained by the division into a plu- 
10 rallty of blocks in accordance with a previously determined block size; 

calculating for each of said blocks a mean value M of the transform coefficients in the blocK and subjecting the 
mean value M to linear quantization using the previously determined quantization step-size, to calculate a 
quantization value; and 

judging whether said quantization value is even or odd, \o extract the embedded digital information on the basis 
IS of the results of the judgmani. 

76. A recording medium having a program executed in a computer recorded thereon, the program realizing on said 
computer an operational environniGnt comprising, with rejipexjt to a digital image signal having inherent digital infor- 
mation embedded by a particular apparatus in trc.nsform coefficients in the lowest frequency band obtained by 

20 dividing the digital image signal using either discrete wave'ot transform or sub-band division, vi^ith using a quanti- 
zation step-size outputled by said particular apparatus and a mean value LM of the transform coefficients in the 
lowest frequency band at the time of output, the steps of: 

dividing said digital image signal into transform coefficients over a plurality of frequency bands using either dis- 

25 Crete wavelet transform or sub-band division; 

calculating a mean value LM' of the transform coefficients in the lowest frequency band out of said plurality of 
frequency bands obtained by the division, anti cubtracling a difference DM (= L.^/l' - LM) betv/een the mean 
value LM' and siiid mam i/alue LM from all thi ; transform coefficients in the lowest frequency band; 
dividing the lowest frequency band after the subtraction of said difference DL into a plurality of blocks in acoord- 

30 ance with a previously determined block size; 

calculating for each of said block's a mean value M of the trisnsform coefficients in the blocK and subjecting the 
mean value tsfl to linear quantization using said quantization 55tGp-size Q, to calculate a quantization value; and 
judging whether said quantization value is 9ven or odd, to extract the embedded digits I information on the basis 
of the results of the judgment. 

55 

77. A recording medium having a program executed in a connputer recorded thereon, the program realizing on said 
computer an operational err/ironment conprising, with respect lo a digital image signal having inherent digital infor- 
mation embedded by a particular apparatus in transform coefficients obtained by subjecting the digital image signal 
to frequency transformation which is any one of discrete cosine transform, Fourier transform and Hadamard trans- 

40 form, then dividing the digital Image signal into block:., and subjecting each of the blocks to orthogonal transform, 
with using a quantization step- size outputled by said |:)atticular apparatus, the steps of: 

dividing said digital image signal into a plurality of blocks each composed of a plumlrty of pixels previously 
determined, and subjecting, for each of the blocks, thu block to orthogonal tr^nsifcrm, to calculate transform 
45 coefficients; 

further clar>sify{ng said plurality of blocks obtained by the divir.ion into groups each comprising one or two or 
more bicckr, in accordance with a previously determined number of blocks; 

calculating for each of said groups a mean value of the respective transform coefficients having the lowest fre- 
quency components in the blocks belonging to the group, and subjecting the mean value to linear quantization 
50 using the pr;2viously determined quantization step-si2:e, to calculate a quantization value; and 

judging whether said quantization value Is even or odd, to extract the embedded digital information on the basis 

of the results of the judgmeriL 

78. A recording medium havina a program executed In a computer reconjed thereon, t!i8 program realizing on said 
55 computer an operational environment comprising, vvith respect to a digital image signal having inherent digital infor- 
mation embedded by a particular apparatus in transform coefficients obtained by subjectinQ tlie digital image signal 
to signal transformation v/hich Is any one of discrete cosine tf ansform. I'ourier transform and Hadamard transform, 
then dividing the digital image signal into blocks, and subjecting ^ch of the blocks to orthogonal transform, with 
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using a quantization step-size outputted by said particular apparatus, and a mean value LM of the amplitiidd values 
of pixels in the digital image signal at the time of output, the steps of: 

calculating a mean value LM' of the amplitude values of the pixels in said digital image signal at the time of 
5 input, and subtracting a difference DM (= LM' - LM) between the mean value LM' and said mean value LM from 

the values of ail the pixels in the digital image signal; 

dividing said digital image signal after the subt/action of said difference DL into a plurality of blocks each com- 
posed of a plurality of pixels previously determined, and subjecting, for each of the blocks, the block to orthog- 
onal transform, to calculate transform coefficients; 
10 further classifying said plurality of blocks obtained by the division into groups each con-uprising one or two or 

more blocks in accordance with a previously determined number of blocks; 

calculating for each of said groups a mean value- of the respective transform coefficients having the lowest fre- 
quency components in the blocks belonging to the group, and subjecting the mean value to linear quantization 
using the previously determinai quantization step-size, to calailate a quantization value; and 
IS judging whether said quantization value is even or odd, to extract the embedded digital information on the basis 

of the results of the judgment. 

79. A recording medium having a program executed in a ccrnpuler recorded therenn, the program realizing on said 
computer an operatic-rtal environment corriprisinci, with respect to a digital image signal having inherent digital infbr- 
20 mation emk)edded by a particular apparatus in a mean value of pixels composing each of blocks obtained by divid- 
ing the digital image signal, with using a quantization step-size outputted by said particulai' apparatus, the steps of; 

dividing said digital image signal into a plurality of blocks, each composed of a plurality of pixels previously 
determined; 

25 calculating for each of said blocks a mean valuo of pixels composing the block, and subjecting the mean 

value to linear quantization using said quantization step-size, to calculate a quantization value; and 
judging whether said (quantization value is even or odd. to extract the en-ttedded digital information on the basis 
of the results of the jidgmtint. 

30 80. A recording medium having a program executed in a conputer recorded thereon, the program realizing on said 
computer an operational envfronment comprising, with reaped to a digital image signal having inherent digital infor- 
mation embeddod by a particular apparatus in a me-m \'alue of pixels composing, each of bIocl« obtained by divid- 
ing the digital image signal, withi using a quantization step-size outputted by said particular apparatus, and a mean 
value LM of the amplitude values al the pixels in the digital imsge signal at th time of output, the steps of; 

35 

calculating a mean value U\l\' of the amplitude values of the pixels in said digital image signal at the time of 
input, and subtracting a difference DL (= LM' - LM) between the mean value LM' and said mean value LM from 
the values of a!I the pixels in the digital Image signal; 

dividing the digital image signal after the subtraction c1 seid difference DL into a plurality cf blocks each com- 
40 posed of a plurality of pixel? previously determined: 

calculating a mean value cf the pixels composing each of the blocks obtained by tlie division, and subjecting 
the mean value to linear quantization using said quantization step-size, to calculate a quantization value; and 
judging whether said quanti,ration value is even or odd. to extract the embedded digital information on the basis 
of the results of the judgment. 

45 

81. A recording mecfium having a prc'gram executed in a computer recorded thereon, the program realizing on said 
computer an operational environment comprising the steps of: 

dividing a digital image signal into transform coefficients ever a pIurali^/ of frequency bands using either dis- 

50 Crete wavelet transform or sub-band division; 

generating, with respect to nach of the transform coefficients included in the one or two frequency bands out 
of said plurality of frequency bands obtained by the division, map information storing a true/false value based 
on decision v/hether or not ?M the absolute amplitude values of the transform coefficient and the other trans- 
form coefficients in the samo space representation region in tl^e same direction of division as the one or two 

65 frequency bands are not more than a previously determined set value; 

replacing all of said transform cosff icient and said oth.er transform coefficients which correspond to the position 
where the true/f^ilse value ci said map information is true v/ith a previously determiniad transform value on the 
basis of the value of said digital information to be 3mbedded In the transform coefficients; and 
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synthesizing said plurality of transform coefficients after said replacement, to reconstruct a digital image signal. 

82. The recording medium according to claim 81 , wherein 

said transform value is set to integers ± K which are not more than said set value, and 
said replacing step replacas ir.ald transform coefficient and said other transform coefficients with the transform 
value + K when each of bits composing said digital information takes a logical value 1, whilo replacing the 
transform coefficients with the transform value - K when said bit takes a logical value 0. 

83. The recording medium according to claim 81 . wherein 

said generating step generates the map information with respect to the transform coefficients included in at 
least one or both of the frequency band which Is low In Its horizontal component and Is high In its vertical com- 
ponent and the frequency band which is high in its horizontal component and is low in Its vertical component 

84. The recording medium according to claim 82. wherein 

said generating step generates the map information with respect to the transform coeffficients included in at 
least one or both of the froqui-sncy band which is lov/ in its horizontal component and is high in its vertical com- 
ponent and the frequency band which is high In it-: hori?:ontal component and is low in its vertical component. 

85. A recording medium having a program executed in a computer recorded thereon, the program realizing on said 
conputer an operational enviriDnrnent comprising the steps of: 

dividing a digital image signal into transform coefficients over a plurality of frequency bands using either dis- 
crete wavelet transform or ^lub-band division; 

generating, with respect tc each of the transfoi m coefflciGnhi included in the one or t\ivo frequency bands out 
of said plurality of frequency tends obtained by the division, map information storing a true/false value based 
on decision whethar q( not the absolute amplitude value of the transform coefficient is included between upper- 
limit and lower-limit threshold values which are previously determined: 

replacing said transform coefficient con'esponding to the position where the true/false value of said map infor- 
mation is true with a previously determined trnnsform value on the basis of the sicn of the transform coefficient 
and the value of said digiiTil Information to be embedded in the transform coefficient; anci 
synthesizing said plurality of transform coefficients after the replacement, to reconstruct a digiteJ image signal. 

86. A recording medium having e progr£:m executed In a computer recorded thereon, the program realizing on said 
computer an operational environment comprising the steps of: 

dividing a digital image nignel into a plurality of block signals of a previously determined size, and subjecting, 
for each of the block signals, the block signal to orthogonal 'ransform, to calculati tra nsform coefficients; 
generating, with respect to each of the transform coefficients included in the one or Uvo block signals out of said 
plurality of block signals obtained by the dl\'ision, map information storing a true/false value based on decision 
whether or not the absolute amplitude value of the t ansform coefficient is Included between upper-limit and 
lower-limit threshold values v/hich are previot'sly dc^termined; 

replacing said transform coefficient corresponding to the posiition where the true/false value of said map infor- 
mation is true with a prwiously deiarniined transform value or. tlie basis of the sign of the transform coefficient 
and the value of said digrtal Information to be embedded In the transform coefficiiDnt: and 
subjecting said plurality of transform coefficients after the replacement to inverse orthogonal transform, to 
reconstruct a digital image signal. 

87. The recording mediumi according to claim 86. wherein 

said calculating step perfc rms frequency transformation whi( h is any one of discrete cosino transform, Fourier 
transform and Hadtimaitl transform. 

88. The recording medium according to claim 85. wherein 

said transform value is set to integers ± A and ± B between said u[}per-(imit and I'swer-limit threshold values. 
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and 

said replacing step replaces said transform coefficient with the transform value + A when each of bits compos- 
ing said digital information takes a logical value 1 and Ihe sign of the transform coefficient is positive, with the 
transform value - A when said bit takes a logical value 1 and the sign of the transform coefficient is negative. 
5 with the transform value + 6 when said bit takes a logiccil value 0 and the sign of the transform coefficient is 

positive, and with the transform value - B when said bit takes a logical value 0 and the sign of the transform 
coefficient is negative. 

89. The recording medium according to claim 86. wherein 

10 

sM transform value is set to integers ± A and ± B between said upper-limit and lower-limit threshold values, 
and 

said replacing step replaces said transform coefficient with the transform value + A when each of bits compos- 
ing said digital information takes a logical value 1 and the sign of the transform coefficient is positive, with the 
15 transform value - A when said bit takes a logical value 1 and the sign of the transform coefficient is negative, 

with the transform value + B when said bit takes a logical value 0 and the sign of the transform coefficient is 
positive, and with the transform value - B when sard bit takes a logical value 0 and the sign cf the transform 
coefficient is negative. 

20 90. The recording medium according to claim 87. wherein 

said transform value is set to integers ± A and discrete wavelet transform or sub-band division, and using map 
information outputted by said particular apparatus and representing ticients in the map information, and 
replaces, when the value of the transform coefficient is not more than the set value, the value with another 
25 value in accordance with the digital information to be embedded. A band synthesis portion 1 7 synthesizes sig- 

nals in the 10 frequency bands each including the replaced transform coefficients, to reconstruct an image sig- 
nal 75. 

91. The recording medium according to claim 85, wherein 

30 

said generating step generates the map information with respect to the respective transform coefficients hav- 
ing the low frequency components other than the DC components. 

92. The recording medium according to claim 86. wherein 

35 

said generating step generates the map information v/ith respect to the respective transform coefficients hav- 
ing the low frequency components other than the DC components. 

93. The recording medium according to claim 87, wherein 

40 

said generating step generates the map information with respect to the respective transform coefficients hav- 
ing the low frequency components other than the DC components. 

94. The recording medium according to claim 88, wherein 

45 

said generating step generates the map information with respect to the respective transform coefficients hav- 
ing the low frequency components other than the DC components. 

95. The recording medium according to claim 89. wheroin 

so 

said generating step generates tiie map information with respect to the respective transform coefficients hav- 
ing the low frequency components other than the DC componenEs. 

96. The recording mediun* according to claim 90, wherein 

55 

said generating step generates the map information with respect to the respective transform coefficients hav- 
ing the low frequency components other than the DC components. 
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97. A recording medium having a program executed in a computer, t'ne program realizing on said computer an opera- 
tional environment comprising, with respect to a digital image signal having inherent digital information embedded 
by a particular apparatus in transform coefficients obtained by dividing the digital image signal using either discrete 
wavelet transform or sub-bartd division, with using map information outputted by said particular apparatus and rep- 

5 resenting the position where said digital information is embedded, the steps of: 

dividing said digital image signal into transform coefficients over a plurality of frequency bands using either dis- 
crete wavelet transform or sub-band division; 

extracting, on the basis of said map information, the transform coefficient corresponding to the position where 
10 a true/lalse value of the map Information is true and the other transform coefficients In the same space repre- 

sentation region In the same direction of division as the frequency band including the transform coefficient; 
calculating a total value of the transform coefficionls inclucsed In the one or two or more frequency bands out 
of said transform coefficient and said other transform coefficients which are extracted; and 
judging the sign of said total value, to ext act the en>b&jded cigital information on the basis of tiie results of the 
75 judgment 

98. A recording medium having a program execulecf In a computer recorded thereon, the program realizing on said 
conputer an operational environment comprising, with respect to a digital image signal having inherent digital infor- 
mation embedded by a particular apparatus in transform coefficients obtained by dividing the ijigitat image signal 

20 using either discrete wavelet transform or sub-band division, with using map information oiilputted by said particu- 
lar apparatus and representing th3 position where said digital information is embedded and information represent- 
ing a transform value to be embisdded, the steps of: 

dividing said image signal into transform coefficients over a plurality of frequency bands using either discrete 
25 wavelet transform or sub-band division; 

extracting, on the basis of said map infcrmation, the transform coefficient corresponding to the position where 
a true/false value of the map infcrmaticn is tru 

calculating an absolute error between said extracted transform coefficient and said transform value; and 
judging the absolute error, to extract the embedded digital information on the basis of the results of the judg- 
30 ment. 

99. A recording medium having ,i program executed in a computer, the program realizing on said cx)mputer an opera- 
tional environment comprising, with respect to a riigitn! imsge signal having inherent digital infonnation embedded 
by a particular apparatus in trsnsform coefficients obtiiined by subjecting the digital image signal to frequency 

35 transformation which is any one of discrete cosine transform, Fourier transform and Hadamard transform, then 
dividing the digital image signal into blocks, and subjecting each of the blocks to orthogonal transform, with using 
nfiap information ciitputted by said particular apparatus and representing the position where said digital information 
is embedded and information representing a transform value to be embedded, the steps of: 

40 dividing isaid digital Imc.gD signal into a pluraiily of block signals of a previously det armined size, and subjecting, 

for each of the block signrJs. th<=i block signal to orthiDgonal tifinsform, to calculates transform coefficients; 
extracting, on the basis of sa^d map irjformation, the transform a^efficient correG|x>nding to the position where 
a true/false value of the map information is true; 

calculating an absolute error between said extracted transform coefficient and said transform value; and 
45 judging the absolute error, to extract the embedded digital InformatitDn on the basis of the results of the Judg- 

ment. 
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